-- Logs begin at Sat 2022-09-24 04:21:40 UTC, end at Sat 2022-09-24 05:16:37 UTC. -- Sep 24 04:46:23.450624 dv-cinder-859186-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 24 04:46:23.458054 dv-cinder-859186-1-smb devstack@keystone.service[81352]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 04:46:23 2022] *** Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: nodename: dv-cinder-859186-1-smb Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: machine: x86_64 Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: clock source: unix Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: pcre jit disabled Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: detected number of CPU cores: 4 Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: current working directory: / Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: detected binary path: /usr/bin/uwsgi-core Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: your processes number limit is 47680 Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: your memory page size is 4096 bytes Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: detected max file descriptor number: 2048 Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: lock engine: pthread robust mutexes Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: thunder lock: enabled Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 24 04:46:23.462778 dv-cinder-859186-1-smb devstack@keystone.service[81352]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 04:46:23.503742 dv-cinder-859186-1-smb devstack@keystone.service[81352]: Python main interpreter initialized at 0x55dabdcc79c0 Sep 24 04:46:23.503742 dv-cinder-859186-1-smb devstack@keystone.service[81352]: python threads support enabled Sep 24 04:46:23.503742 dv-cinder-859186-1-smb devstack@keystone.service[81352]: your server socket listen backlog is limited to 100 connections Sep 24 04:46:23.503742 dv-cinder-859186-1-smb devstack@keystone.service[81352]: your mercy for graceful operations on workers is 90 seconds Sep 24 04:46:23.504116 dv-cinder-859186-1-smb devstack@keystone.service[81352]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 04:46:23.504206 dv-cinder-859186-1-smb devstack@keystone.service[81352]: *** Operational MODE: preforking *** Sep 24 04:46:23.504440 dv-cinder-859186-1-smb devstack@keystone.service[81352]: *** uWSGI is running in multiple interpreter mode *** Sep 24 04:46:23.504440 dv-cinder-859186-1-smb devstack@keystone.service[81352]: spawned uWSGI master process (pid: 81352) Sep 24 04:46:23.504650 dv-cinder-859186-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 24 04:46:23.506062 dv-cinder-859186-1-smb devstack@keystone.service[81352]: spawned uWSGI worker 1 (pid: 81362, cores: 1) Sep 24 04:46:23.506062 dv-cinder-859186-1-smb devstack@keystone.service[81352]: spawned uWSGI worker 2 (pid: 81363, cores: 1) Sep 24 04:46:23.506220 dv-cinder-859186-1-smb devstack@keystone.service[81352]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 04:46:27.801273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:46:27.801273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: from cryptography.utils import int_from_bytes Sep 24 04:46:27.802055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:46:27.802055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: from cryptography.utils import int_from_bytes Sep 24 04:46:27.802200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:46:27.802200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: from cryptography.utils import int_from_bytes Sep 24 04:46:27.802200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:46:27.802200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: from cryptography.utils import int_from_bytes Sep 24 04:46:27.851766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 04:46:27.851937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 04:46:27.852030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 04:46:27.852116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] command line args: [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 04:46:27.852194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 04:46:27.852316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] command line args: [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 04:46:27.852391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 04:46:27.852550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ================================================================================ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 04:46:27.852635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 04:46:27.852751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ================================================================================ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 04:46:27.852836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] admin_token = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] admin_token = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_dir = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] config_dir = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853390 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_source = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] debug = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] config_source = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] debug = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.853836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.854065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.854201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.854298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.854408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.854510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.854604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.854696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.854828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.855042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.855186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.855317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.855474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_config_append = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.855637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_config_append = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.855835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.855991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_dir = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_dir = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_file = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.856985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857389 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857865 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.857937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.858926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] publish_errors = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] publish_errors = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.859991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.860987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] standard_threads = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] standard_threads = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_journal = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.861933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_journal = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_json = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_json = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_stderr = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_stderr = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_syslog = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] use_syslog = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:46:27.862726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.862823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.862988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.863088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.863248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.863326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.863482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.863563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.863729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.863815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.863964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.864040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.864210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.864286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.864442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.864528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.864687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.864770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.864929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.865971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.866124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.866209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.866369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.866452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.866602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.866689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.866878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.866956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.867133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.867209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.867376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.867537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.867617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.867688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.867842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.867926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.868102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.868186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.868354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.868430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.868599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.868676 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.868828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.868913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.869057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.869132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.869282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.869365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.869515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.869593 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.869758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.869840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.870001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.870077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.870225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.870302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.870453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.871070 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.871271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.871404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.871546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.871683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.871816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.871907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.871985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872747 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.872967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.873116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.873194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.873344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.873420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.873821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.873907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.874049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.874133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.874294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.874382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.874521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.874609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.874799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.874881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.875957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.876034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.876190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.876265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.876424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.876500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.876656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.876733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.876892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.877942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.878063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.878167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.878293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.878420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.878547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.878636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.878800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.878897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.879031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.879109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.879268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.879347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.879498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.879586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.879763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.879841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.880954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.881985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.882139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.882216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.882376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.882464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.882619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.882695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.882875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.882955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.883109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.883202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.883343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.883420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.883574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.883650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.883807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.883892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.884063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.884140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.884302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.884378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.884547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.884632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.884786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.884863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885019 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.885945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.886032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.886228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.887013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.887128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.887268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.887398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.887530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.887672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.887820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.887953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.888082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.888213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.888340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.888480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.888606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.888733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.888857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.888985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.889110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.889252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.889379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.889505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.889629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.889757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.889934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.890082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.external = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.890225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.external = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.890365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.890506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.890641 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.890803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.890945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.891085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.891248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.password = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.891391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.password = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.891520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.token = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.891655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] auth.token = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.891788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.891920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.892968 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.893919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.894036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.894122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.894286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.894365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.894522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.894603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.894789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.894872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.895076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.895154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.895319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.895399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.895581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.895660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.895823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.895901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.896076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.896154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.896307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.896387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.896540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.896618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.896784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.896863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897739 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.897989 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.898075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.898226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.898304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.898478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.898556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.898713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.898819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.898982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.899060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.899213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.899290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.899459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.899611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.899686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.899756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.899923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.900951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.901109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.901186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.901360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.901436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.901586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.901671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.901840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.901962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.902096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.902229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.902363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.902478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.902555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.902728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.902866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.903002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.903077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.903258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.903339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.903505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.903586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.903762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.903840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.904992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.905150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.905228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.905387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.905465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.905622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.905698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.905855 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.905933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.906083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.906162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.906328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.906407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.906563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.906640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.906835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.906918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.907085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.907173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.907317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.907402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.907550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.907628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.907779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.907856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.908949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.909027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.909226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.909311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.909434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.909544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.909780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.909858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.910982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.911995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.912165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.912243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.912393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.912479 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.912639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.912718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.912885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.912962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.913121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.913208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.913352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.913430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.913579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.913656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.913812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.913901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.914043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.914120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.914272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.914349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.914498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.914583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.914745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.914846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.915952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916664 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.916974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.917128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.917204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.917369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.917497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.917650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.917761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.917889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.918027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.918285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.918386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.918518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.918597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.918776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.918859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.919962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.920993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.921145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.921231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.921376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.921453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.921623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.921701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.921856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.921942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.922089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.922166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.922331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.922409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.922564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.922715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.922824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] role.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.922897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.923057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] role.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.923137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.923289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.923370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.923537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.923616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.923784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.923863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.924997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.925074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.925239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.925317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.925469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.925548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.925700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.925783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.925942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.926021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.926186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.926266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.926428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.926507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.926673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.926840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.927079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.927159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.927319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.927395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.927570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.927647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.927820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.927900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.928068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.928147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.928303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.928391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.928534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.928613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.928788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.928867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.929939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.930017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.930192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.930277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.930440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.930526 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.930677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.930775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.930935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931389 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.931945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.932092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.932170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.932322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.932400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.932576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.932663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.932812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.932890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.933582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.933678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.933914 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.934066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.934208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.934331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.934442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.934524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.934679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.934882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.934960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.935986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.936143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.936229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.936406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.936486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.936649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.936729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.936896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.936973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.937131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.937209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.937368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.937447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.937601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.937679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.937833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.937910 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.938067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.938146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.938299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.938376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.938533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.938612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.938790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.938874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.939972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.940050 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.940202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.940280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.940430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.940507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.940663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.940740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.940821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 04:46:27.940899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:46:27.941048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 04:46:27.970596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:27.970845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:27.971079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:27.971495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:27.971729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:27.971954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:27.979462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:27.980876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.008027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.008255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.008500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.008732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.061684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.062086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.110148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.110380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.110650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.110912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.265642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.265906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.266049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.266182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.266332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.266480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.266608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.266734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.266900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.267028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.267165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.267290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.289643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.289910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.290047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.290178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.290317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.290444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.290580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.290705 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.290856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.290992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.291119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.291244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.291367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.291367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.302649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.303371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.315900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.316102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.316241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.316391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.316524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.316653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.316783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.316910 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.317039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.317177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.317309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.317437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.317576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.317705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 04:46:28.333922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.334131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 04:46:28.334264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.334394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 04:46:28.334522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.334650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 04:46:28.334818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.334947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.335032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 04:46:28.335210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.335339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.335480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.335612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.335783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.335915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.336044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.345287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.345560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.345809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.345948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.346083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.346227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.346369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.346625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.353111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.353562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.356632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.356908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.357189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.357318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.357472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.357610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.357758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.357893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.358019 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.358143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.358292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.358431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.358592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.358718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.358865 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.358993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.359133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.359274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.359404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.359533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.359662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.359882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.383159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.384528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.384659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.384882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.385971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.386280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.389558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.389845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.390129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.391070 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.391360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.391640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.396427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.396722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.397897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.398179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.402337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.402626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.402938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.403227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.403508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.403786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.403956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.404081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.404232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.404359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.404522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.404804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.405075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.405346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.405615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.405882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.420286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.420567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.421853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.422133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.424403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.425951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.427644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.427943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.429187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.429478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.432122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.434226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.435790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.437416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.438966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.439267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.439553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.439840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.440123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.440408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.440604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.440901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.441185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.441468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.441761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.442052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.455844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.456130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.456396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.456665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.457784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.458070 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.458340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.458602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.463424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.464961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.465512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.466453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.466735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.467054 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.468562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.468839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.469445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.469729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.470014 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.470300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.470692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.471520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.471808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.472088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.472367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.472760 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.482263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.482545 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.482858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.483143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.483524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.483803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.484082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.484279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.484561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.484840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.485122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.485500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.485780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.486059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.499763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.501539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.502639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.504429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.505547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.507026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.507316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.508475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.508758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.508841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.509147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.510197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.510479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.510899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.516237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.517648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.517740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.519178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.520536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.520930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.521218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.521499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.522014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.522405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.522697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.523000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.529332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.529638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.529930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.530878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.531168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.531459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.536780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.537062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.537350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.537630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.537908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.538184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.538265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 04:46:28.538461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.538551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.538762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.538846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.539043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.539125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.539324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.539417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.539596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.539677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.539870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.539951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.540149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.540229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.540422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.540546 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.540700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.540979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.541248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.541630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.541905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 04:46:28.576083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dabdcc79c0 pid: 81363 (default app) Sep 24 04:46:28.577712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dabdcc79c0 pid: 81362 (default app) Sep 24 04:46:28.579383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0db7-bd7b-46bc-96f1-34bd095e2cd6 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:28.579670 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0db7-bd7b-46bc-96f1-34bd095e2cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:28.579944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0db7-bd7b-46bc-96f1-34bd095e2cd6 None None] PATH_INFO: `/v3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:28.584065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Sat Sep 24 04:46:28 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:35.333564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564239d-7bae-4006-bc63-5e865c543e39 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:35.334093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564239d-7bae-4006-bc63-5e865c543e39 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:35.334093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564239d-7bae-4006-bc63-5e865c543e39 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:35.338341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:35.344097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:35.344677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:35.344677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:35.415818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: INFO dbcounter [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] Registered counter for database keystone Sep 24 04:46:35.436016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG oslo_db.sqlalchemy.engines [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:46:35.442164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writer thread running {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:46:35.620828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG passlib.handlers.bcrypt [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81363) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 04:46:35.621108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG passlib.handlers.bcrypt [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81363) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 04:46:35.679445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:35.681065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:35.809855 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 24 04:46:36.122923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564239d-7bae-4006-bc63-5e865c543e39 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:36.193057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: INFO dbcounter [None req-2564239d-7bae-4006-bc63-5e865c543e39 None None] Registered counter for database keystone Sep 24 04:46:36.214944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG oslo_db.sqlalchemy.engines [None req-2564239d-7bae-4006-bc63-5e865c543e39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:46:36.221366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writer thread running {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:46:36.344555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564239d-7bae-4006-bc63-5e865c543e39 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:36.348833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbef7e-eb12-40e1-adbb-61ebb72563aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:36.349449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbef7e-eb12-40e1-adbb-61ebb72563aa admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:36.349726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbef7e-eb12-40e1-adbb-61ebb72563aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:36.349994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbef7e-eb12-40e1-adbb-61ebb72563aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:36.358925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbef7e-eb12-40e1-adbb-61ebb72563aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:36.411690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fdbbef7e-eb12-40e1-adbb-61ebb72563aa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 04:46:36.411980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbef7e-eb12-40e1-adbb-61ebb72563aa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:36.421738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Sep 24 04:46:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 04:46:36.428026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:36.444906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76789ef2-a474-4fb0-b34c-3d3f1d9646b8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:36.449667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91647b71-ec13-430e-b18d-b39cd0de070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:36.450780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91647b71-ec13-430e-b18d-b39cd0de070d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:36.451140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91647b71-ec13-430e-b18d-b39cd0de070d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:36.451413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91647b71-ec13-430e-b18d-b39cd0de070d admin admin] PATH_INFO: `/v3/projects/8b234c6113f54a018ff39cafffcc9b40` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:36.453024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91647b71-ec13-430e-b18d-b39cd0de070d admin admin] RBAC: Authorizing `identity:get_project(project_id=8b234c6113f54a018ff39cafffcc9b40)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:36.506915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING keystone.common.rbac_enforcer.enforcer [None req-91647b71-ec13-430e-b18d-b39cd0de070d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 04:46:36.507261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91647b71-ec13-430e-b18d-b39cd0de070d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:36.512265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Sat Sep 24 04:46:36 2022] GET /identity/v3/projects/8b234c6113f54a018ff39cafffcc9b40 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:38.702366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7f46-4604-4f6a-bcee-cd551eded07e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:38.702921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7f46-4604-4f6a-bcee-cd551eded07e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:38.702921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7f46-4604-4f6a-bcee-cd551eded07e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:38.707008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:46:38.712350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99670dd-ba4b-4ff9-8077-1d1c299673de None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:38.712766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99670dd-ba4b-4ff9-8077-1d1c299673de None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:38.712900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99670dd-ba4b-4ff9-8077-1d1c299673de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:38.733603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b99670dd-ba4b-4ff9-8077-1d1c299673de None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:38.735204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b99670dd-ba4b-4ff9-8077-1d1c299673de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:38.742984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 24 04:46:39.030867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a7f46-4604-4f6a-bcee-cd551eded07e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:39.043627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a7f46-4604-4f6a-bcee-cd551eded07e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:39.047861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654b7c7-1f30-479f-9b44-3df5f1042b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:39.048449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654b7c7-1f30-479f-9b44-3df5f1042b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:39.048728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654b7c7-1f30-479f-9b44-3df5f1042b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:39.048999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654b7c7-1f30-479f-9b44-3df5f1042b5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:39.056838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654b7c7-1f30-479f-9b44-3df5f1042b5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:39.059299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654b7c7-1f30-479f-9b44-3df5f1042b5c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:39.067843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Sep 24 04:46:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 04:46:39.073180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99670dd-ba4b-4ff9-8077-1d1c299673de None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:39.082330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99670dd-ba4b-4ff9-8077-1d1c299673de None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:39.086553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d743c1-e4c6-4a10-8ef9-b3fa91958acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:39.087206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d743c1-e4c6-4a10-8ef9-b3fa91958acb admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:39.087483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d743c1-e4c6-4a10-8ef9-b3fa91958acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:39.087753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d743c1-e4c6-4a10-8ef9-b3fa91958acb admin admin] PATH_INFO: `/v3/users/c9d20f523caa4aca808612f9ede7fc85` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:39.089575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d743c1-e4c6-4a10-8ef9-b3fa91958acb admin admin] RBAC: Authorizing `identity:get_user(user_id=c9d20f523caa4aca808612f9ede7fc85)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:39.091417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d743c1-e4c6-4a10-8ef9-b3fa91958acb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:39.092927 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Sat Sep 24 04:46:39 2022] GET /identity/v3/users/c9d20f523caa4aca808612f9ede7fc85 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:41.308856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b61b9-b816-4392-8b65-57fd33d79ac3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:41.309409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b61b9-b816-4392-8b65-57fd33d79ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:41.309409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b61b9-b816-4392-8b65-57fd33d79ac3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:41.310708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:46:41.316031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cc69b-8113-401e-a0d4-f3066a4d4435 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:41.316462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cc69b-8113-401e-a0d4-f3066a4d4435 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:41.316706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cc69b-8113-401e-a0d4-f3066a4d4435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:41.334917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b18cc69b-8113-401e-a0d4-f3066a4d4435 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:41.336105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b18cc69b-8113-401e-a0d4-f3066a4d4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:41.339256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d113-95a5-4ffb-a02c-fd2d9e6b677e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:41.339536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d113-95a5-4ffb-a02c-fd2d9e6b677e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:41.339804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d113-95a5-4ffb-a02c-fd2d9e6b677e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:41.341097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:46:41.346290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c275-0211-4274-a21f-db8b3045446e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:41.346570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c275-0211-4274-a21f-db8b3045446e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:41.346871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c275-0211-4274-a21f-db8b3045446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:41.390041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG passlib.handlers.bcrypt [None req-b128c275-0211-4274-a21f-db8b3045446e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 04:46:41.390428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG passlib.handlers.bcrypt [None req-b128c275-0211-4274-a21f-db8b3045446e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 04:46:41.419149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:41.440061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b128c275-0211-4274-a21f-db8b3045446e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:41.441642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b128c275-0211-4274-a21f-db8b3045446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:41.539923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:46:41.690284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cc69b-8113-401e-a0d4-f3066a4d4435 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:41.715529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:41.796345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cc69b-8113-401e-a0d4-f3066a4d4435 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:41.804264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c275-0211-4274-a21f-db8b3045446e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:41.830056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a738326-748e-4ad2-8f18-68b2f29334a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:41.830695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a738326-748e-4ad2-8f18-68b2f29334a0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:41.831013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a738326-748e-4ad2-8f18-68b2f29334a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:41.831289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a738326-748e-4ad2-8f18-68b2f29334a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:41.842705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a738326-748e-4ad2-8f18-68b2f29334a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5a738326-748e-4ad2-8f18-68b2f29334a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:46:41.851481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:41.852509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:46:41.853332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:46:41.858323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a738326-748e-4ad2-8f18-68b2f29334a0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:41.906856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c275-0211-4274-a21f-db8b3045446e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:41.909074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:41.939867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:41.943930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab375-00a5-4ee3-a985-6b4140481f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:41.944778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab375-00a5-4ee3-a985-6b4140481f51 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:41.945054 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab375-00a5-4ee3-a985-6b4140481f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:41.945320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab375-00a5-4ee3-a985-6b4140481f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:41.958266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a738326-748e-4ad2-8f18-68b2f29334a0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:41.992661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:41.993263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:41.993542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:41.993816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:41.994492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:41.995413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:41.996809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:42.008473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:42.014125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab375-00a5-4ee3-a985-6b4140481f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:42.014251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:42.015681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab375-00a5-4ee3-a985-6b4140481f51 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:42.114044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eafe0-c3db-4cf1-abc2-41f35c9a557e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:42.114673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 04:46:42.120436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab375-00a5-4ee3-a985-6b4140481f51 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:42.124209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:42.148552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278ce5e-7495-4d5e-8734-720b5cfffbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:42.149181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ce5e-7495-4d5e-8734-720b5cfffbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:42.149462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ce5e-7495-4d5e-8734-720b5cfffbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:42.149734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ce5e-7495-4d5e-8734-720b5cfffbb9 None admin] PATH_INFO: `/v3/users/c9d20f523caa4aca808612f9ede7fc85` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:42.150894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278ce5e-7495-4d5e-8734-720b5cfffbb9 None admin] RBAC: Authorizing `identity:get_user(user_id=c9d20f523caa4aca808612f9ede7fc85)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:42.152426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278ce5e-7495-4d5e-8734-720b5cfffbb9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:42.153977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:46:42 2022] GET /identity/v3/users/c9d20f523caa4aca808612f9ede7fc85 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:42.159428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278ce5e-7495-4d5e-8734-720b5cfffbb9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:42.174116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:42.219697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab375-00a5-4ee3-a985-6b4140481f51 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:42.252655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:42.253498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:42.253771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:42.254043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:42.257856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278ce5e-7495-4d5e-8734-720b5cfffbb9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:42.272967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:42.274409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:42.292043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529457-40c4-4888-b915-8f6daedf90dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:42.292661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529457-40c4-4888-b915-8f6daedf90dd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:46:42.292774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:42.293744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:46:42.294562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:46:42.294562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:46:42.294562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:46:42.294740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529457-40c4-4888-b915-8f6daedf90dd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:42.294740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529457-40c4-4888-b915-8f6daedf90dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:42.294905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:46:42.294971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f529457-40c4-4888-b915-8f6daedf90dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:42.295712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f529457-40c4-4888-b915-8f6daedf90dd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:42.297224 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:42.299641 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:42.302925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529457-40c4-4888-b915-8f6daedf90dd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:42.355459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:42.383633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:42.403767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf821-473c-4602-999d-459aa3f12441 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:42.404075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529457-40c4-4888-b915-8f6daedf90dd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:42.436819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cc0fe-a1d1-4a84-987b-23d96e0d2260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:42.437032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fad4f4-23e8-42f7-8dc4-6c3668a63029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:42.437417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc0fe-a1d1-4a84-987b-23d96e0d2260 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:42.437623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fad4f4-23e8-42f7-8dc4-6c3668a63029 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:42.437724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc0fe-a1d1-4a84-987b-23d96e0d2260 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:42.437901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fad4f4-23e8-42f7-8dc4-6c3668a63029 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:42.437985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc0fe-a1d1-4a84-987b-23d96e0d2260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:42.438172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fad4f4-23e8-42f7-8dc4-6c3668a63029 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:42.438647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc0fe-a1d1-4a84-987b-23d96e0d2260 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.domain.id=default, user.id=c9d20f523caa4aca808612f9ede7fc85) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:42.438835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fad4f4-23e8-42f7-8dc4-6c3668a63029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:42.438986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc0fe-a1d1-4a84-987b-23d96e0d2260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:42.439143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fad4f4-23e8-42f7-8dc4-6c3668a63029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:42.440407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc0fe-a1d1-4a84-987b-23d96e0d2260 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:42.440497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fad4f4-23e8-42f7-8dc4-6c3668a63029 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:42.446868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Sep 24 04:46:42 2022] GET /identity/v3/role_assignments?user.id=c9d20f523caa4aca808612f9ede7fc85&scope.domain.id=default&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:42.459162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:44.875013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb381a7-7594-456e-bdcb-27dd285811d0 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:44.875566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb381a7-7594-456e-bdcb-27dd285811d0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:44.875566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb381a7-7594-456e-bdcb-27dd285811d0 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:44.876938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:44.882816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2da5-ab42-4469-a9a3-c35b1b646f5f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:44.883317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2da5-ab42-4469-a9a3-c35b1b646f5f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:44.883474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2da5-ab42-4469-a9a3-c35b1b646f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:44.912305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a07e2da5-ab42-4469-a9a3-c35b1b646f5f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:44.913441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a07e2da5-ab42-4469-a9a3-c35b1b646f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:45.000831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:45.012411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b0dcf-4ef1-49f2-a2e6-22811f50131e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:45.012712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b0dcf-4ef1-49f2-a2e6-22811f50131e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:45.012966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b0dcf-4ef1-49f2-a2e6-22811f50131e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:45.014297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:45.032717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff70d-9bd7-4f84-b3bf-35383297ed9d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:45.033007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff70d-9bd7-4f84-b3bf-35383297ed9d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:45.033282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff70d-9bd7-4f84-b3bf-35383297ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:45.060765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4e1ff70d-9bd7-4f84-b3bf-35383297ed9d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:45.061954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e1ff70d-9bd7-4f84-b3bf-35383297ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:45.122378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:45.160135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:46:45.283082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f2cca-65de-43de-952d-a5f6f1f1cdbd None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:45.283777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f2cca-65de-43de-952d-a5f6f1f1cdbd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:45.284268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f2cca-65de-43de-952d-a5f6f1f1cdbd None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:45.286223 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 14/26] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:45.291953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3307-d052-445c-b142-04d3fbad4690 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:45.292484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3307-d052-445c-b142-04d3fbad4690 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:45.292982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d3307-d052-445c-b142-04d3fbad4690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:45.323809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bd4d3307-d052-445c-b142-04d3fbad4690 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:45.325356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bd4d3307-d052-445c-b142-04d3fbad4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:45.405460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:45.547231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f2cca-65de-43de-952d-a5f6f1f1cdbd None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:45.691586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f2cca-65de-43de-952d-a5f6f1f1cdbd None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:45.730317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19eac5-d03e-478c-9e97-14380a5e75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:45.731002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19eac5-d03e-478c-9e97-14380a5e75ab None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:45.731269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19eac5-d03e-478c-9e97-14380a5e75ab None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:45.731538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19eac5-d03e-478c-9e97-14380a5e75ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:45.732621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d3307-d052-445c-b142-04d3fbad4690 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:45.758941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19eac5-d03e-478c-9e97-14380a5e75ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-fb19eac5-d03e-478c-9e97-14380a5e75ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:46:45.768624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:45.769499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:46:45.770256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:46:45.770862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 15/28] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:46:45.782868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19eac5-d03e-478c-9e97-14380a5e75ab None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:45.789064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:45.920387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19eac5-d03e-478c-9e97-14380a5e75ab None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:45.937583 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d3307-d052-445c-b142-04d3fbad4690 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:45.953730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:45.961664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:45.962493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:45.962992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:45.964189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:45.965270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:45.965744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:45.967436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:45.976570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 16/29] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:45.978001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:46.031493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:46.032151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.032435 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.032712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.053172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:46.054670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:46:46.080159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:46.081066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:46:46.081841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:46:46.081841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:46:46.081841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:46:46.081841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 14/30] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:46:46.086930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:46.087723 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:46.093355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66f80-0e65-41a7-a983-1da1ee815b69 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:46.131549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d93d15-20f9-49b7-bb43-d4ab24f7e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:46.132460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d93d15-20f9-49b7-bb43-d4ab24f7e009 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.132897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d93d15-20f9-49b7-bb43-d4ab24f7e009 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.133318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d93d15-20f9-49b7-bb43-d4ab24f7e009 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.134130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d93d15-20f9-49b7-bb43-d4ab24f7e009 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:46.135841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d93d15-20f9-49b7-bb43-d4ab24f7e009 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:46.202687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f48eb-944f-4885-b4cb-e271e8fe2680 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:46.239514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07d9a1-b12d-4288-86fd-44599613e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:46.240148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07d9a1-b12d-4288-86fd-44599613e420 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.240479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07d9a1-b12d-4288-86fd-44599613e420 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.240758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07d9a1-b12d-4288-86fd-44599613e420 None admin] PATH_INFO: `/v3/users/c9d20f523caa4aca808612f9ede7fc85` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.242238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07d9a1-b12d-4288-86fd-44599613e420 None admin] RBAC: Authorizing `identity:get_user(user_id=c9d20f523caa4aca808612f9ede7fc85)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:46.243939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07d9a1-b12d-4288-86fd-44599613e420 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:46.250541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 15/31] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:46:46 2022] GET /identity/v3/users/c9d20f523caa4aca808612f9ede7fc85 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:46.250541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07d9a1-b12d-4288-86fd-44599613e420 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:46.276990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 17/32] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 24 04:46:45 2022] POST /identity/v3/roles => generated 219 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:46:46.278777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e83f-43b1-4bb5-bb2d-d417720c3311 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.279250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e83f-43b1-4bb5-bb2d-d417720c3311 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.279690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e83f-43b1-4bb5-bb2d-d417720c3311 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.281119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 18/33] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:46.282227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e83f-43b1-4bb5-bb2d-d417720c3311 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:46.285471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:46.403577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e83f-43b1-4bb5-bb2d-d417720c3311 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:46.415461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07d9a1-b12d-4288-86fd-44599613e420 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:46.455354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:46.462626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:46.464890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.465185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.465443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.466118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:46.466425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:46.468478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:46.476216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64453e74-c21f-483d-a10b-998d87608b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:46.476872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453e74-c21f-483d-a10b-998d87608b8d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.479922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453e74-c21f-483d-a10b-998d87608b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.480231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453e74-c21f-483d-a10b-998d87608b8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.481689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64453e74-c21f-483d-a10b-998d87608b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:46.483459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64453e74-c21f-483d-a10b-998d87608b8d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:46.485667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 19/34] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:46.487127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44c99-21fe-40f3-a6f2-98cf24f8d075 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.487416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44c99-21fe-40f3-a6f2-98cf24f8d075 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.487693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44c99-21fe-40f3-a6f2-98cf24f8d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.501357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 16/35] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:46.501619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:46.515620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-aca44c99-21fe-40f3-a6f2-98cf24f8d075 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:46.517439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-aca44c99-21fe-40f3-a6f2-98cf24f8d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:46.633660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 20/36] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:46.634939 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca44c99-21fe-40f3-a6f2-98cf24f8d075 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:46.661012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:46.680936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dc9e0-a86c-41df-b9f7-5d2b33d92b85 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:46.733166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431cd6e-e62a-4e13-9db7-07f6f5933bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:46.734168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431cd6e-e62a-4e13-9db7-07f6f5933bbf None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.734660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431cd6e-e62a-4e13-9db7-07f6f5933bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.735160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431cd6e-e62a-4e13-9db7-07f6f5933bbf None admin] PATH_INFO: `/v3/domains/default/users/c9d20f523caa4aca808612f9ede7fc85/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.737344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431cd6e-e62a-4e13-9db7-07f6f5933bbf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c9d20f523caa4aca808612f9ede7fc85, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:46.739026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431cd6e-e62a-4e13-9db7-07f6f5933bbf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:46.775516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca44c99-21fe-40f3-a6f2-98cf24f8d075 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:46.802563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:46.814202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1fc5-8e57-4d3a-8db4-1338511cc336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:46.814842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1fc5-8e57-4d3a-8db4-1338511cc336 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.815125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1fc5-8e57-4d3a-8db4-1338511cc336 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.815396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1fc5-8e57-4d3a-8db4-1338511cc336 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.816042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a1fc5-8e57-4d3a-8db4-1338511cc336 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:46.817547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a1fc5-8e57-4d3a-8db4-1338511cc336 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:46.854248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 21/37] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:46:46 2022] POST /identity/v3/projects => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:46:46.854248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb823d93-d255-4615-b8e9-f7979e025208 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.854248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb823d93-d255-4615-b8e9-f7979e025208 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.854248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb823d93-d255-4615-b8e9-f7979e025208 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.854248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 22/38] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:46.854248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf408-1979-4aaf-a5f7-4decc684aa65 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.854248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf408-1979-4aaf-a5f7-4decc684aa65 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.854907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf408-1979-4aaf-a5f7-4decc684aa65 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.854907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 23/39] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:46.862582 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 17/40] 10.222.0.26 () {58 vars in 1361 bytes} [Sat Sep 24 04:46:46 2022] PUT /identity/v3/domains/default/users/c9d20f523caa4aca808612f9ede7fc85/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:46:46.863312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77e9e-c049-445d-a9db-2ab83f3e6204 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.863715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77e9e-c049-445d-a9db-2ab83f3e6204 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.864037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77e9e-c049-445d-a9db-2ab83f3e6204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.872568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2aaf-370c-43b2-b569-26b5f30649a8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:46.872882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2aaf-370c-43b2-b569-26b5f30649a8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:46.873129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2aaf-370c-43b2-b569-26b5f30649a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:46.932711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7add2aaf-370c-43b2-b569-26b5f30649a8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:46.934353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7add2aaf-370c-43b2-b569-26b5f30649a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:47.006566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dab77e9e-c049-445d-a9db-2ab83f3e6204 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:47.007842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dab77e9e-c049-445d-a9db-2ab83f3e6204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:47.035136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 18/41] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:47.036698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2aaf-370c-43b2-b569-26b5f30649a8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:47.106811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 24/42] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:47.131737 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:47.157084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2aaf-370c-43b2-b569-26b5f30649a8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:47.199590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931885e-8e98-4d0c-996e-3a9e33d6e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:47.200562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931885e-8e98-4d0c-996e-3a9e33d6e18f None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:47.201047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931885e-8e98-4d0c-996e-3a9e33d6e18f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:47.201537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931885e-8e98-4d0c-996e-3a9e33d6e18f None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:47.202419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931885e-8e98-4d0c-996e-3a9e33d6e18f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:47.204269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931885e-8e98-4d0c-996e-3a9e33d6e18f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:47.225700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 19/43] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 24 04:46:47 2022] POST /identity/v3/roles => generated 225 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:46:47.344334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77e9e-c049-445d-a9db-2ab83f3e6204 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:47.396859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931885e-8e98-4d0c-996e-3a9e33d6e18f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:47.468688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77e9e-c049-445d-a9db-2ab83f3e6204 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:47.477000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:47.511592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161d284-0338-4a01-a88c-0f4b5dd91925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:47.512231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d284-0338-4a01-a88c-0f4b5dd91925 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:47.512552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d284-0338-4a01-a88c-0f4b5dd91925 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:47.512829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d284-0338-4a01-a88c-0f4b5dd91925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:47.514144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161d284-0338-4a01-a88c-0f4b5dd91925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:47.515622 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161d284-0338-4a01-a88c-0f4b5dd91925 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:47.517726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 25/44] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:47.523014 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161d284-0338-4a01-a88c-0f4b5dd91925 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:47.524053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931885e-8e98-4d0c-996e-3a9e33d6e18f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:47.563124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afd3a8-d91a-4235-ad23-ea6a155953de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:47.563738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd3a8-d91a-4235-ad23-ea6a155953de None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:47.564017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd3a8-d91a-4235-ad23-ea6a155953de None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:47.564292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd3a8-d91a-4235-ad23-ea6a155953de None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:47.564963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afd3a8-d91a-4235-ad23-ea6a155953de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:47.566338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afd3a8-d91a-4235-ad23-ea6a155953de None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:47.571211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:47.588148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 20/45] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 24 04:46:47 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:46:47.639970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161d284-0338-4a01-a88c-0f4b5dd91925 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:47.684982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883a522-029e-4b9d-80fe-98daa8379c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:47.685637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a522-029e-4b9d-80fe-98daa8379c06 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:47.685919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a522-029e-4b9d-80fe-98daa8379c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:47.686191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a522-029e-4b9d-80fe-98daa8379c06 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:47.686901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883a522-029e-4b9d-80fe-98daa8379c06 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:47.688379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883a522-029e-4b9d-80fe-98daa8379c06 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:47.719854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 26/46] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:46:47 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:46:49.185654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ff0d-e4ee-4d4c-a59a-c32d41e2c428 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:49.186196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ff0d-e4ee-4d4c-a59a-c32d41e2c428 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:49.186196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ff0d-e4ee-4d4c-a59a-c32d41e2c428 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:49.187580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 21/47] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:49.192921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef49978-4c3f-487f-b5bb-0c6c4a6a48db None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:49.193318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef49978-4c3f-487f-b5bb-0c6c4a6a48db None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:49.193471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef49978-4c3f-487f-b5bb-0c6c4a6a48db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:49.211746 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3ef49978-4c3f-487f-b5bb-0c6c4a6a48db None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:49.212933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3ef49978-4c3f-487f-b5bb-0c6c4a6a48db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:49.233626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:49.281056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 27/48] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:49.552000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8ff0d-e4ee-4d4c-a59a-c32d41e2c428 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:49.653113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8ff0d-e4ee-4d4c-a59a-c32d41e2c428 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:49.686841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82de2b-b2ba-4005-a3cb-eea5affb7884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:49.687464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82de2b-b2ba-4005-a3cb-eea5affb7884 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:49.687740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82de2b-b2ba-4005-a3cb-eea5affb7884 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:49.688007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82de2b-b2ba-4005-a3cb-eea5affb7884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:49.700020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82de2b-b2ba-4005-a3cb-eea5affb7884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1d82de2b-b2ba-4005-a3cb-eea5affb7884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:46:49.705870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:49.706702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:46:49.707492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 22/49] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:46:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:46:49.714262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef49978-4c3f-487f-b5bb-0c6c4a6a48db None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:49.814862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef49978-4c3f-487f-b5bb-0c6c4a6a48db None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:49.848129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7883bf3-123f-4ae8-8fef-f514b2899623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:49.848735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883bf3-123f-4ae8-8fef-f514b2899623 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:49.849019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883bf3-123f-4ae8-8fef-f514b2899623 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:49.849294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883bf3-123f-4ae8-8fef-f514b2899623 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:49.849960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7883bf3-123f-4ae8-8fef-f514b2899623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:49.850267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7883bf3-123f-4ae8-8fef-f514b2899623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:49.851674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7883bf3-123f-4ae8-8fef-f514b2899623 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:49.859916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 28/50] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:46:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:49.865629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82de2b-b2ba-4005-a3cb-eea5affb7884 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:49.889835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33e72-dec2-4032-b0a8-e1f8b7253e7e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:49.890124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33e72-dec2-4032-b0a8-e1f8b7253e7e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:49.890397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33e72-dec2-4032-b0a8-e1f8b7253e7e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:49.891793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 29/51] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:46:49.896629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd62cf-37d7-4530-ac44-22cee78ac312 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:49.896914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd62cf-37d7-4530-ac44-22cee78ac312 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:49.897188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd62cf-37d7-4530-ac44-22cee78ac312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:49.914478 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a3bd62cf-37d7-4530-ac44-22cee78ac312 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:49.915681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a3bd62cf-37d7-4530-ac44-22cee78ac312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:49.922827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:49.928889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:49.967844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82de2b-b2ba-4005-a3cb-eea5affb7884 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:49.984748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 30/52] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:46:50.000233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feab84-6e91-4b32-b550-8f935968dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:50.000851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feab84-6e91-4b32-b550-8f935968dddc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:50.001125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feab84-6e91-4b32-b550-8f935968dddc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:50.001393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feab84-6e91-4b32-b550-8f935968dddc None admin] PATH_INFO: `/v3/users/c9d20f523caa4aca808612f9ede7fc85` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:50.002495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37feab84-6e91-4b32-b550-8f935968dddc None admin] RBAC: Authorizing `identity:get_user(user_id=c9d20f523caa4aca808612f9ede7fc85)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:50.003952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37feab84-6e91-4b32-b550-8f935968dddc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:50.005502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 23/53] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:46:49 2022] GET /identity/v3/users/c9d20f523caa4aca808612f9ede7fc85 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:50.011625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd62cf-37d7-4530-ac44-22cee78ac312 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:50.106857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd62cf-37d7-4530-ac44-22cee78ac312 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:50.139664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe1b54-1d47-4bad-b56e-e7e8cabe90f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:50.140295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1b54-1d47-4bad-b56e-e7e8cabe90f7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:50.140571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1b54-1d47-4bad-b56e-e7e8cabe90f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:50.140838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1b54-1d47-4bad-b56e-e7e8cabe90f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:50.141976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe1b54-1d47-4bad-b56e-e7e8cabe90f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:50.143448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe1b54-1d47-4bad-b56e-e7e8cabe90f7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:50.144991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 31/54] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:50.151318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feab84-6e91-4b32-b550-8f935968dddc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:50.246598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feab84-6e91-4b32-b550-8f935968dddc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:50.256966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe1b54-1d47-4bad-b56e-e7e8cabe90f7 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:50.271315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:50.277032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:50.282370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:50.283014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:50.283292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:50.283563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:50.284284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.domain.id=default, user.id=c9d20f523caa4aca808612f9ede7fc85) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:50.284591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:50.286026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:50.294460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 24/55] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Sep 24 04:46:50 2022] GET /identity/v3/role_assignments?user.id=c9d20f523caa4aca808612f9ede7fc85&scope.domain.id=default&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:50.364985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe1b54-1d47-4bad-b56e-e7e8cabe90f7 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:50.400179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf69e23-504c-4ba1-9011-5d55a06c3543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:50.401429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf69e23-504c-4ba1-9011-5d55a06c3543 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:50.401708 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf69e23-504c-4ba1-9011-5d55a06c3543 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:50.401985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf69e23-504c-4ba1-9011-5d55a06c3543 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:50.403169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf69e23-504c-4ba1-9011-5d55a06c3543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:50.404662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf69e23-504c-4ba1-9011-5d55a06c3543 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:50.406279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 32/56] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:46:50.411954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:50.619204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee240f41-9de8-4901-9bdb-785e80f8fe17 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:50.654712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b971eeb-cb1b-42f9-a409-9cce7bbb585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:50.655347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971eeb-cb1b-42f9-a409-9cce7bbb585a None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:50.655635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971eeb-cb1b-42f9-a409-9cce7bbb585a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:50.655910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971eeb-cb1b-42f9-a409-9cce7bbb585a None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:50.656573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b971eeb-cb1b-42f9-a409-9cce7bbb585a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:50.658020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b971eeb-cb1b-42f9-a409-9cce7bbb585a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:50.686348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 25/57] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Sep 24 04:46:50 2022] POST /identity/v3/projects => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:46:52.826799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43631e-8bfa-4220-8fb0-6c0f6879f752 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:52.827315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43631e-8bfa-4220-8fb0-6c0f6879f752 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:52.827401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43631e-8bfa-4220-8fb0-6c0f6879f752 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:52.828652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 33/58] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:52.833735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bca6-0be3-4e6a-bebc-f7208185e356 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:52.834170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bca6-0be3-4e6a-bebc-f7208185e356 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:52.834283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bca6-0be3-4e6a-bebc-f7208185e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:52.852749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4c28bca6-0be3-4e6a-bebc-f7208185e356 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:52.854734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4c28bca6-0be3-4e6a-bebc-f7208185e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:52.887441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:52.920215 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 26/59] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:53.200207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43631e-8bfa-4220-8fb0-6c0f6879f752 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:53.285709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:53.302125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43631e-8bfa-4220-8fb0-6c0f6879f752 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:53.336154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d1f95-6fc2-42c9-8449-99cecb4b02a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:53.336775 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1f95-6fc2-42c9-8449-99cecb4b02a7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:53.337058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1f95-6fc2-42c9-8449-99cecb4b02a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:53.337334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d1f95-6fc2-42c9-8449-99cecb4b02a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:53.339091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d1f95-6fc2-42c9-8449-99cecb4b02a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:53.340558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d1f95-6fc2-42c9-8449-99cecb4b02a7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:53.342121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 34/60] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:53.347806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28bca6-0be3-4e6a-bebc-f7208185e356 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:53.443295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28bca6-0be3-4e6a-bebc-f7208185e356 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:53.475874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b64d30-fae5-4824-bb1a-fdd47bba7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:53.476409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b64d30-fae5-4824-bb1a-fdd47bba7253 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:53.476689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b64d30-fae5-4824-bb1a-fdd47bba7253 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:53.476960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b64d30-fae5-4824-bb1a-fdd47bba7253 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:53.477611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b64d30-fae5-4824-bb1a-fdd47bba7253 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:53.479233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b64d30-fae5-4824-bb1a-fdd47bba7253 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:53.505138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 27/61] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:46:53 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:46:56.825078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42877f-90af-4445-b9fa-aadf000aa952 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:56.826092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42877f-90af-4445-b9fa-aadf000aa952 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:56.826582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42877f-90af-4445-b9fa-aadf000aa952 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:56.828447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 35/62] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:56.833404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ef09d-da4c-410e-b9e9-c037953964a1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:56.834205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ef09d-da4c-410e-b9e9-c037953964a1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:56.834696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ef09d-da4c-410e-b9e9-c037953964a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:56.858161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-312ef09d-da4c-410e-b9e9-c037953964a1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:56.859745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-312ef09d-da4c-410e-b9e9-c037953964a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:56.886784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:56.907234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf1d7-8132-490d-acc5-bf4406a2b4b6 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:56.907820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf1d7-8132-490d-acc5-bf4406a2b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:56.908288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf1d7-8132-490d-acc5-bf4406a2b4b6 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:56.911308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 36/63] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:56.915753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693292ff-779e-4243-ad21-c5668267e3a6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:56.916821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693292ff-779e-4243-ad21-c5668267e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:56.917343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693292ff-779e-4243-ad21-c5668267e3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:56.951569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 28/64] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:56.956485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-693292ff-779e-4243-ad21-c5668267e3a6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:56.957858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-693292ff-779e-4243-ad21-c5668267e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:57.028862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 37/65] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:57.095491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601123-be21-4966-83c7-91caf91aaefe None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.095773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601123-be21-4966-83c7-91caf91aaefe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.096209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601123-be21-4966-83c7-91caf91aaefe None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.097943 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 29/66] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:57.103461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1346-450f-4929-a47a-b4409fd14a43 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.103915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1346-450f-4929-a47a-b4409fd14a43 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.104333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1346-450f-4929-a47a-b4409fd14a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.131773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-698d1346-450f-4929-a47a-b4409fd14a43 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:57.133236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-698d1346-450f-4929-a47a-b4409fd14a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:57.231402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 38/67] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:57.255091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601123-be21-4966-83c7-91caf91aaefe None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:57.356824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951596-1f22-4825-9197-bc3552e4bb9f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.357339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951596-1f22-4825-9197-bc3552e4bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.357783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951596-1f22-4825-9197-bc3552e4bb9f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.359286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 39/68] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:46:57.364149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ceb9d-4d4a-43e7-bde9-98a07bf0b195 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.364721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ceb9d-4d4a-43e7-bde9-98a07bf0b195 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.365276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ceb9d-4d4a-43e7-bde9-98a07bf0b195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.396314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-332ceb9d-4d4a-43e7-bde9-98a07bf0b195 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:57.397777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-332ceb9d-4d4a-43e7-bde9-98a07bf0b195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:57.405176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601123-be21-4966-83c7-91caf91aaefe None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:57.423119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:57.450717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47094023-3ba5-4784-8666-72f0c188d62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:57.451687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094023-3ba5-4784-8666-72f0c188d62a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.452109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094023-3ba5-4784-8666-72f0c188d62a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.452523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094023-3ba5-4784-8666-72f0c188d62a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.464773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47094023-3ba5-4784-8666-72f0c188d62a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-47094023-3ba5-4784-8666-72f0c188d62a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:46:57.471441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:57.472419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:46:57.473179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:46:57.475387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 30/69] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:46:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:46:57.482462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47094023-3ba5-4784-8666-72f0c188d62a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:57.501333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 40/70] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:46:57.506908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:57.508019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ceb9d-4d4a-43e7-bde9-98a07bf0b195 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:57.600386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47094023-3ba5-4784-8666-72f0c188d62a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:57.638958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd9fd-24b4-48a3-bf31-e0c71dd7980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:57.639198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ceb9d-4d4a-43e7-bde9-98a07bf0b195 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:57.639954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd9fd-24b4-48a3-bf31-e0c71dd7980a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.640369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd9fd-24b4-48a3-bf31-e0c71dd7980a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.640841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd9fd-24b4-48a3-bf31-e0c71dd7980a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.653284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbd9fd-24b4-48a3-bf31-e0c71dd7980a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1bcbd9fd-24b4-48a3-bf31-e0c71dd7980a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:46:57.662584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:57.663548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:46:57.664304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:46:57.667951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 31/71] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:46:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:46:57.668933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd9fd-24b4-48a3-bf31-e0c71dd7980a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:57.681501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:57.682266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.682540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.682871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.683547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:57.683855 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:57.685237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:57.693470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 41/72] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:46:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:57.694417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:57.699837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:57.757757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:57.784558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd9fd-24b4-48a3-bf31-e0c71dd7980a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:57.811423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbacb37-1022-41e7-966c-361d31caed8c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:57.820215 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8c54b-5b85-4202-9ef7-72ab5af3794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:57.821031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8c54b-5b85-4202-9ef7-72ab5af3794f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.821456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8c54b-5b85-4202-9ef7-72ab5af3794f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.821909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8c54b-5b85-4202-9ef7-72ab5af3794f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.833296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8c54b-5b85-4202-9ef7-72ab5af3794f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-68d8c54b-5b85-4202-9ef7-72ab5af3794f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:46:57.838788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:57.843023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 32/73] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:46:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:46:57.843807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d1958-850c-475b-b938-78703eac5eb5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.844479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d1958-850c-475b-b938-78703eac5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.844479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d1958-850c-475b-b938-78703eac5eb5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.844479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 33/74] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:46:57.844479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d1958-850c-475b-b938-78703eac5eb5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:57.848183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:57.848799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.849077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.849351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.850020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:57.850325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:57.851742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:57.864920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 42/75] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:46:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:57.864920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:57.925728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:57.947454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d1958-850c-475b-b938-78703eac5eb5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:57.960827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9fe59-d800-4590-b1c1-151bc4a6c618 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:57.981081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94627c-9a94-4cfa-9422-e27100845cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:57.981705 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94627c-9a94-4cfa-9422-e27100845cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.981986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94627c-9a94-4cfa-9422-e27100845cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.982258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94627c-9a94-4cfa-9422-e27100845cc6 None admin] PATH_INFO: `/v3/users/c9d20f523caa4aca808612f9ede7fc85` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.983419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94627c-9a94-4cfa-9422-e27100845cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=c9d20f523caa4aca808612f9ede7fc85)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:57.984875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94627c-9a94-4cfa-9422-e27100845cc6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:57.986453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 34/76] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:46:57 2022] GET /identity/v3/users/c9d20f523caa4aca808612f9ede7fc85 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:57.987248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94627c-9a94-4cfa-9422-e27100845cc6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:57.991437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:57.995522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9198c10-4405-4a8a-8b49-be0d50c9e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:57.996155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9198c10-4405-4a8a-8b49-be0d50c9e545 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:57.996433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9198c10-4405-4a8a-8b49-be0d50c9e545 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:57.996701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9198c10-4405-4a8a-8b49-be0d50c9e545 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:57.997823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9198c10-4405-4a8a-8b49-be0d50c9e545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:57.999549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9198c10-4405-4a8a-8b49-be0d50c9e545 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:58.001083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 43/77] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:46:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:58.002161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff133a7-b100-4c10-8b25-1078ed41a7e4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.002438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff133a7-b100-4c10-8b25-1078ed41a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.002710 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff133a7-b100-4c10-8b25-1078ed41a7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.020562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0ff133a7-b100-4c10-8b25-1078ed41a7e4 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:46:58.021667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0ff133a7-b100-4c10-8b25-1078ed41a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:46:58.087011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 44/78] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:46:58.088416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff133a7-b100-4c10-8b25-1078ed41a7e4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.093966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94627c-9a94-4cfa-9422-e27100845cc6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:58.134269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:58.135651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.136303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.136434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.137007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:58.137309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:58.138676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:58.154990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 35/79] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:46:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:58.154990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.157677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:58.197143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff133a7-b100-4c10-8b25-1078ed41a7e4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:58.228931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:58.232112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fffc1-bc29-4b91-a359-bc3fae30bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:58.232877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fffc1-bc29-4b91-a359-bc3fae30bcff None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.233333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fffc1-bc29-4b91-a359-bc3fae30bcff None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.233519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fffc1-bc29-4b91-a359-bc3fae30bcff None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.247642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fffc1-bc29-4b91-a359-bc3fae30bcff None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:58.249365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fffc1-bc29-4b91-a359-bc3fae30bcff None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:58.251114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 45/80] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:46:58 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:58.251862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fffc1-bc29-4b91-a359-bc3fae30bcff None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.273934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d7298-36f5-476c-bdb5-5d62deed08c3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:58.311219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492c1-ba65-463a-9834-2c909680c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:58.311826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492c1-ba65-463a-9834-2c909680c995 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.312108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492c1-ba65-463a-9834-2c909680c995 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.312399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492c1-ba65-463a-9834-2c909680c995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.356633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fffc1-bc29-4b91-a359-bc3fae30bcff None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:58.378984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:58.380799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957492c1-ba65-463a-9834-2c909680c995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:58.382367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957492c1-ba65-463a-9834-2c909680c995 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:58.395219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd261-41ea-4553-8d12-be454743aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:58.395817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd261-41ea-4553-8d12-be454743aac8 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.396094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd261-41ea-4553-8d12-be454743aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.396360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd261-41ea-4553-8d12-be454743aac8 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.397012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fd261-41ea-4553-8d12-be454743aac8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:58.398428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fd261-41ea-4553-8d12-be454743aac8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:58.425432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 46/81] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:46:58 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:46:58.426352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd261-41ea-4553-8d12-be454743aac8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.452937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:58.494391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 36/82] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:46:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:46:58.495288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492c1-ba65-463a-9834-2c909680c995 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.550736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd261-41ea-4553-8d12-be454743aac8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:58.591941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce97d-a059-44ca-ace0-8a862395a88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:58.592596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce97d-a059-44ca-ace0-8a862395a88d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.592880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce97d-a059-44ca-ace0-8a862395a88d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.593160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce97d-a059-44ca-ace0-8a862395a88d None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.594369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bce97d-a059-44ca-ace0-8a862395a88d None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:58.595898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bce97d-a059-44ca-ace0-8a862395a88d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:58.597572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 47/83] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:46:58 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:58.598259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce97d-a059-44ca-ace0-8a862395a88d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.614260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492c1-ba65-463a-9834-2c909680c995 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:58.656271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:58.665167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623244-04de-4582-ad0e-aa1f044df95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:58.665857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623244-04de-4582-ad0e-aa1f044df95b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.666480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623244-04de-4582-ad0e-aa1f044df95b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.667237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623244-04de-4582-ad0e-aa1f044df95b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.709442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:58.727879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce97d-a059-44ca-ace0-8a862395a88d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:58.757243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623244-04de-4582-ad0e-aa1f044df95b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:58.759234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623244-04de-4582-ad0e-aa1f044df95b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:58.769329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe0d43-368c-44bf-8512-f777dddde96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:58.770019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe0d43-368c-44bf-8512-f777dddde96a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.770298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe0d43-368c-44bf-8512-f777dddde96a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.770567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe0d43-368c-44bf-8512-f777dddde96a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.782641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe0d43-368c-44bf-8512-f777dddde96a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c5fe0d43-368c-44bf-8512-f777dddde96a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:46:58.788993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:46:58.789980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:46:58.790975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:46:58.793390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 48/84] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:46:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:46:58.794498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe0d43-368c-44bf-8512-f777dddde96a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.895567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 37/85] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:46:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:46:58.896504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623244-04de-4582-ad0e-aa1f044df95b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.911266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe0d43-368c-44bf-8512-f777dddde96a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:58.920970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:58.950517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c5ee8-ee69-40a3-ac6e-c5919a7d3277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:58.951454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c5ee8-ee69-40a3-ac6e-c5919a7d3277 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:58.951881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c5ee8-ee69-40a3-ac6e-c5919a7d3277 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:58.952297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c5ee8-ee69-40a3-ac6e-c5919a7d3277 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:58.953596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c5ee8-ee69-40a3-ac6e-c5919a7d3277 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:58.955333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c5ee8-ee69-40a3-ac6e-c5919a7d3277 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:58.957157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 49/86] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:46:58 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:58.958083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c5ee8-ee69-40a3-ac6e-c5919a7d3277 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:58.994628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:59.039445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623244-04de-4582-ad0e-aa1f044df95b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.077661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c5ee8-ee69-40a3-ac6e-c5919a7d3277 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.077895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcff43f-ee98-4dfa-99db-d827b6598105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:59.078287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff43f-ee98-4dfa-99db-d827b6598105 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:59.078569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff43f-ee98-4dfa-99db-d827b6598105 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:59.078872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff43f-ee98-4dfa-99db-d827b6598105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:59.114898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:59.115781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:59.116208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:59.116663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:59.117468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:59.117992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:59.120000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:59.129517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 50/87] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:46:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:59.130690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:59.169987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:59.175074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcff43f-ee98-4dfa-99db-d827b6598105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:59.177664 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcff43f-ee98-4dfa-99db-d827b6598105 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:59.240540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551240-1f05-4b5e-a04a-395d0f5dc42e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.271257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:59.278551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b0444-1b8a-497e-8cdd-fce292d11e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:59.279518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b0444-1b8a-497e-8cdd-fce292d11e05 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:59.280002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b0444-1b8a-497e-8cdd-fce292d11e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:59.280517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b0444-1b8a-497e-8cdd-fce292d11e05 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:59.281969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b0444-1b8a-497e-8cdd-fce292d11e05 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:59.283683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b0444-1b8a-497e-8cdd-fce292d11e05 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:59.285825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 51/88] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:46:59 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:59.286941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b0444-1b8a-497e-8cdd-fce292d11e05 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:59.307208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 38/89] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:46:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:46:59.310939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcff43f-ee98-4dfa-99db-d827b6598105 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:59.405258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b0444-1b8a-497e-8cdd-fce292d11e05 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.408826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:59.441526 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcff43f-ee98-4dfa-99db-d827b6598105 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.443800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:59.444707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:59.445188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:59.445662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:59.446605 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a, user.id=c9d20f523caa4aca808612f9ede7fc85) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:59.447190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:59.448860 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:59.455369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 52/90] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:46:59 2022] GET /identity/v3/role_assignments?user.id=c9d20f523caa4aca808612f9ede7fc85&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:59.456721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:59.510905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9c513-6596-4375-a1b0-1f8a472a2eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:59.512938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c513-6596-4375-a1b0-1f8a472a2eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:59.514696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c513-6596-4375-a1b0-1f8a472a2eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:59.515209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c513-6596-4375-a1b0-1f8a472a2eb9 None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:59.517794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9c513-6596-4375-a1b0-1f8a472a2eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:59.520357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9c513-6596-4375-a1b0-1f8a472a2eb9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:59.525953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 39/91] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:46:59 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:59.525953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9c513-6596-4375-a1b0-1f8a472a2eb9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:59.570736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:59.647312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9c513-6596-4375-a1b0-1f8a472a2eb9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.657793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53d060-25d2-468d-aae0-69d0ef18ff51 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.692631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff667517-dd97-430a-962b-4ef069ae79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:59.699223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff667517-dd97-430a-962b-4ef069ae79c4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:59.699533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff667517-dd97-430a-962b-4ef069ae79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:59.699776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff667517-dd97-430a-962b-4ef069ae79c4 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:59.701124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff667517-dd97-430a-962b-4ef069ae79c4 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:59.702605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff667517-dd97-430a-962b-4ef069ae79c4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:59.704525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 40/92] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:46:59 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:59.705128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff667517-dd97-430a-962b-4ef069ae79c4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:59.714506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:59.716519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:59.717029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:59.717502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:46:59.718483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] RBAC: Adding query filter params (role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a, user.id=6658db19c88f4761aa337219a7f426b5) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:46:59.719117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:46:59.720817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:46:59.727839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 53/93] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:46:59 2022] GET /identity/v3/role_assignments?user.id=6658db19c88f4761aa337219a7f426b5&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:46:59.729762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:46:59.791999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:59.910482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff667517-dd97-430a-962b-4ef069ae79c4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.916024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:46:59.967173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a50beb-b59a-49b5-8779-31f4dfac36f6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:46:59.990559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49815-cb71-457f-9ef1-4a9886b3fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:46:59.993184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49815-cb71-457f-9ef1-4a9886b3fe27 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:46:59.993717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49815-cb71-457f-9ef1-4a9886b3fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:46:59.994305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49815-cb71-457f-9ef1-4a9886b3fe27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:00.041294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:00.042282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:00.042776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:00.043261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:00.044184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] RBAC: Adding query filter params (role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a, user.id=6658db19c88f4761aa337219a7f426b5) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:00.045230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:00.048211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:00.060432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 54/94] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:46:59 2022] GET /identity/v3/role_assignments?user.id=6658db19c88f4761aa337219a7f426b5&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=043adf092a6b422e961a0edc97df0a66 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:00.100871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c49815-cb71-457f-9ef1-4a9886b3fe27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:00.102694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c49815-cb71-457f-9ef1-4a9886b3fe27 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:00.208009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 41/95] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:00.214976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:00.342142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:00.348334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9bb88-5923-4e17-8466-1d844d9d053d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:00.386863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9f833-942d-4126-8a72-d02e312d43b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:00.387567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f833-942d-4126-8a72-d02e312d43b8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:00.387854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f833-942d-4126-8a72-d02e312d43b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:00.388129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f833-942d-4126-8a72-d02e312d43b8 None admin] PATH_INFO: `/v3/projects/c4eb6dad57544338a311f592afd53b86` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:00.389310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9f833-942d-4126-8a72-d02e312d43b8 None admin] RBAC: Authorizing `identity:get_project(project_id=c4eb6dad57544338a311f592afd53b86)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:00.390823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9f833-942d-4126-8a72-d02e312d43b8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:00.392841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 55/96] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:00 2022] GET /identity/v3/projects/c4eb6dad57544338a311f592afd53b86 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:00.399049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49815-cb71-457f-9ef1-4a9886b3fe27 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:00.401498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:00.516437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49815-cb71-457f-9ef1-4a9886b3fe27 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:00.552619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6b757-303b-4580-b7e9-b885e406a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:00.553225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b757-303b-4580-b7e9-b885e406a856 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:00.553504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b757-303b-4580-b7e9-b885e406a856 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:00.553773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b757-303b-4580-b7e9-b885e406a856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:00.554495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6b757-303b-4580-b7e9-b885e406a856 None admin] RBAC: Adding query filter params (role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=c4eb6dad57544338a311f592afd53b86, user.id=6658db19c88f4761aa337219a7f426b5) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:00.554829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6b757-303b-4580-b7e9-b885e406a856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:00.556290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6b757-303b-4580-b7e9-b885e406a856 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:00.562135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 42/97] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:00 2022] GET /identity/v3/role_assignments?user.id=6658db19c88f4761aa337219a7f426b5&scope.project.id=c4eb6dad57544338a311f592afd53b86&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:01.118205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c418061-db88-4fe9-bc5c-165785f9f428 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:01.119308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c418061-db88-4fe9-bc5c-165785f9f428 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:01.119308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c418061-db88-4fe9-bc5c-165785f9f428 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:01.120711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 56/98] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:01.136747 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f84f7-c557-450a-8a2d-a70595d2d249 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:01.137031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f84f7-c557-450a-8a2d-a70595d2d249 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:01.137309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f84f7-c557-450a-8a2d-a70595d2d249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:01.141172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa5a55-6e3e-4e5d-8814-0889f75ed486 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:01.141619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa5a55-6e3e-4e5d-8814-0889f75ed486 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:01.141691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa5a55-6e3e-4e5d-8814-0889f75ed486 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:01.151904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 43/99] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:01.163601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-332f84f7-c557-450a-8a2d-a70595d2d249 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:01.164825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-332f84f7-c557-450a-8a2d-a70595d2d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:01.169012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca13f5-b81a-472e-a112-5e3792d20303 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:01.169294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca13f5-b81a-472e-a112-5e3792d20303 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:01.169563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca13f5-b81a-472e-a112-5e3792d20303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:01.189069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-beca13f5-b81a-472e-a112-5e3792d20303 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:01.190581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-beca13f5-b81a-472e-a112-5e3792d20303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:01.252310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 57/100] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:01.341803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:01.352950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 44/101] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:01.576528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f84f7-c557-450a-8a2d-a70595d2d249 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:01.705061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:01.712186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f84f7-c557-450a-8a2d-a70595d2d249 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:01.760865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcfd05-0e9e-4163-bc5d-dc0b0ff7fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:01.761509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcfd05-0e9e-4163-bc5d-dc0b0ff7fa42 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:01.761791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcfd05-0e9e-4163-bc5d-dc0b0ff7fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:01.762064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcfd05-0e9e-4163-bc5d-dc0b0ff7fa42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:01.763274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcfd05-0e9e-4163-bc5d-dc0b0ff7fa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:01.764738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcfd05-0e9e-4163-bc5d-dc0b0ff7fa42 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:01.766319 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 58/102] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:01.771806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca13f5-b81a-472e-a112-5e3792d20303 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:01.851869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcfd05-0e9e-4163-bc5d-dc0b0ff7fa42 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:01.917235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca13f5-b81a-472e-a112-5e3792d20303 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:02.002109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195225-6239-4097-80e1-0920396f7124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:02.003612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195225-6239-4097-80e1-0920396f7124 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:02.003906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195225-6239-4097-80e1-0920396f7124 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:02.004189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195225-6239-4097-80e1-0920396f7124 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:02.004875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16195225-6239-4097-80e1-0920396f7124 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:02.006324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16195225-6239-4097-80e1-0920396f7124 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:02.055548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 45/103] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:47:01 2022] POST /identity/v3/projects => generated 302 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:47:02.066313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcfd05-0e9e-4163-bc5d-dc0b0ff7fa42 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:02.121065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6569-0092-432e-ac9d-6c62ce77fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:02.121675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6569-0092-432e-ac9d-6c62ce77fde5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:02.121897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6569-0092-432e-ac9d-6c62ce77fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:02.122159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6569-0092-432e-ac9d-6c62ce77fde5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:02.136766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f6569-0092-432e-ac9d-6c62ce77fde5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-8d0f6569-0092-432e-ac9d-6c62ce77fde5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:02.142883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:02.143688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:02.144443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 59/104] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:02.150624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195225-6239-4097-80e1-0920396f7124 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:02.234970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:02.308799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195225-6239-4097-80e1-0920396f7124 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:02.348934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:02.349597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:02.349886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:02.350164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:02.350857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:02.351167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:02.352525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:02.369725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 46/105] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:02.376351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6569-0092-432e-ac9d-6c62ce77fde5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:02.417664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:02.528793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6569-0092-432e-ac9d-6c62ce77fde5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:02.574842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6f426-0e06-435e-a691-f5e63104df90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:02.575486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6f426-0e06-435e-a691-f5e63104df90 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:02.575772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6f426-0e06-435e-a691-f5e63104df90 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:02.576047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6f426-0e06-435e-a691-f5e63104df90 None admin] PATH_INFO: `/v3/users/55702b8a00264879b560e447d2694364` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:02.594008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6f426-0e06-435e-a691-f5e63104df90 None admin] RBAC: Authorizing `identity:get_user(user_id=55702b8a00264879b560e447d2694364)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:02.595529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6f426-0e06-435e-a691-f5e63104df90 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:02.597563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 60/106] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:02 2022] GET /identity/v3/users/55702b8a00264879b560e447d2694364 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:02.603303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:02.770045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a5a0-3974-4d5d-9732-44a33799a3c9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:02.781880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:02.806157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2275b-7c75-46a2-baf3-1d9a746c939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:02.807247 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2275b-7c75-46a2-baf3-1d9a746c939f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:02.807733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2275b-7c75-46a2-baf3-1d9a746c939f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:02.808227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2275b-7c75-46a2-baf3-1d9a746c939f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:02.888663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2275b-7c75-46a2-baf3-1d9a746c939f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:02.890453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2275b-7c75-46a2-baf3-1d9a746c939f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:03.009495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 47/107] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:03.015312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6f426-0e06-435e-a691-f5e63104df90 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:03.057420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c69e-1389-4100-91ce-1af7797a20cf None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.057748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c69e-1389-4100-91ce-1af7797a20cf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.058107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c69e-1389-4100-91ce-1af7797a20cf None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.059345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 48/108] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:03.073613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d15d-d61f-4c1f-8324-dab1d95db872 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.073893 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d15d-d61f-4c1f-8324-dab1d95db872 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.074162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d15d-d61f-4c1f-8324-dab1d95db872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.112859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1460d15d-d61f-4c1f-8324-dab1d95db872 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:03.114082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1460d15d-d61f-4c1f-8324-dab1d95db872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:03.121869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:03.153713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:03.186657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6f426-0e06-435e-a691-f5e63104df90 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:03.252875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d020cf-bfda-4a72-95a2-88fdef3113b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:03.254845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d020cf-bfda-4a72-95a2-88fdef3113b1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.256191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d020cf-bfda-4a72-95a2-88fdef3113b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.256670 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d020cf-bfda-4a72-95a2-88fdef3113b1 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.259380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d020cf-bfda-4a72-95a2-88fdef3113b1 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:03.262529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d020cf-bfda-4a72-95a2-88fdef3113b1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:03.266350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 61/109] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:03 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:03.269418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6957c-3aa7-4da4-91a1-5c9901db0bde None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.270433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6957c-3aa7-4da4-91a1-5c9901db0bde None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.272812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 49/110] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:03.273709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6957c-3aa7-4da4-91a1-5c9901db0bde None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.276500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460d15d-d61f-4c1f-8324-dab1d95db872 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:03.277160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 62/111] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:03.282908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441bbb-ec01-4835-967c-6bfc5351f5ae None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.283185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441bbb-ec01-4835-967c-6bfc5351f5ae None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.283455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441bbb-ec01-4835-967c-6bfc5351f5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.316231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f1441bbb-ec01-4835-967c-6bfc5351f5ae None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:03.317482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f1441bbb-ec01-4835-967c-6bfc5351f5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:03.393988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460d15d-d61f-4c1f-8324-dab1d95db872 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:03.442677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fbf2-0d81-45ca-a5f8-01a9ea78c796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:03.443612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fbf2-0d81-45ca-a5f8-01a9ea78c796 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.444071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fbf2-0d81-45ca-a5f8-01a9ea78c796 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.444739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fbf2-0d81-45ca-a5f8-01a9ea78c796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.446415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fbf2-0d81-45ca-a5f8-01a9ea78c796 None admin] RBAC: Adding query filter params (role.id=68ce6057586947a4abce25fb4a5752ab, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a, user.id=55702b8a00264879b560e447d2694364) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:03.447163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fbf2-0d81-45ca-a5f8-01a9ea78c796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:03.448949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fbf2-0d81-45ca-a5f8-01a9ea78c796 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:03.451052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 63/112] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:03.461774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 50/113] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:03 2022] GET /identity/v3/role_assignments?user.id=55702b8a00264879b560e447d2694364&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=68ce6057586947a4abce25fb4a5752ab => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:03.574116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa699c-c3f2-4efc-8dc3-337a25afc1c8 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.574378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa699c-c3f2-4efc-8dc3-337a25afc1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.574789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa699c-c3f2-4efc-8dc3-337a25afc1c8 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.576283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 64/114] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:03.582140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29bcb-b680-4173-8743-3f0dd309c64f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.582696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29bcb-b680-4173-8743-3f0dd309c64f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.583240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29bcb-b680-4173-8743-3f0dd309c64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.594467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:03.612913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4fe29bcb-b680-4173-8743-3f0dd309c64f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:03.614454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4fe29bcb-b680-4173-8743-3f0dd309c64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:03.705127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 51/115] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:03.766069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa699c-c3f2-4efc-8dc3-337a25afc1c8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:03.796272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29bcb-b680-4173-8743-3f0dd309c64f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:03.888678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:03.914200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa699c-c3f2-4efc-8dc3-337a25afc1c8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:03.952508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36212674-fc1b-499c-add8-7b80f6a68fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:03.953156 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212674-fc1b-499c-add8-7b80f6a68fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:03.953431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212674-fc1b-499c-add8-7b80f6a68fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:03.953701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212674-fc1b-499c-add8-7b80f6a68fb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:03.970902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36212674-fc1b-499c-add8-7b80f6a68fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-36212674-fc1b-499c-add8-7b80f6a68fb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:03.975798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:03.976646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:03.977392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 65/116] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:03.983751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36212674-fc1b-499c-add8-7b80f6a68fb1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.043953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29bcb-b680-4173-8743-3f0dd309c64f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.111403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb87114-66d7-4bd4-b671-46b3c755a91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:04.112057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb87114-66d7-4bd4-b671-46b3c755a91d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.112336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb87114-66d7-4bd4-b671-46b3c755a91d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.112609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb87114-66d7-4bd4-b671-46b3c755a91d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.115685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:04.136577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb87114-66d7-4bd4-b671-46b3c755a91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-afb87114-66d7-4bd4-b671-46b3c755a91d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:04.142282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:04.143239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:04.144001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:04.148652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 52/117] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:04.150862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb87114-66d7-4bd4-b671-46b3c755a91d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.154072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36212674-fc1b-499c-add8-7b80f6a68fb1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.224874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:04.225491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.225766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.226031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.226696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:04.227023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:04.228691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:04.236810 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:04.245411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 66/118] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:04.246593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.313568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb87114-66d7-4bd4-b671-46b3c755a91d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.354112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55b59d-04ac-4a13-bf67-331bf65ece72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:04.355385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b59d-04ac-4a13-bf67-331bf65ece72 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.355869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b59d-04ac-4a13-bf67-331bf65ece72 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.356337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b59d-04ac-4a13-bf67-331bf65ece72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.361173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e4ba-40f6-4df6-bdb4-9f95bac66696 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.367917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b59d-04ac-4a13-bf67-331bf65ece72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3b55b59d-04ac-4a13-bf67-331bf65ece72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:04.374003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:04.374888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:04.375649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:04.377991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 53/119] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:04.379474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468253a0-e8a5-4581-9e67-c018ed6c9e27 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.379955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468253a0-e8a5-4581-9e67-c018ed6c9e27 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.380445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468253a0-e8a5-4581-9e67-c018ed6c9e27 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.382524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 54/120] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:04.387711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468253a0-e8a5-4581-9e67-c018ed6c9e27 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.404181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:04.404862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.405143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.405464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.406447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:04.406553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:04.408020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:04.422447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 67/121] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:04.427420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.459680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:04.501613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:04.512204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468253a0-e8a5-4581-9e67-c018ed6c9e27 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.551645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732f4aa-05ac-48aa-9f64-b520d422d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:04.552633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f4aa-05ac-48aa-9f64-b520d422d28f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.552739 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b31d1-74af-4299-b4aa-802f4712716f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.553206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f4aa-05ac-48aa-9f64-b520d422d28f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.553692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f4aa-05ac-48aa-9f64-b520d422d28f None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.555217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732f4aa-05ac-48aa-9f64-b520d422d28f None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:04.558642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732f4aa-05ac-48aa-9f64-b520d422d28f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:04.560505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 55/122] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:04 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:04.566290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87a59b-9201-412b-a381-38e5f288285a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.566829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87a59b-9201-412b-a381-38e5f288285a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.567299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87a59b-9201-412b-a381-38e5f288285a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.588537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-db87a59b-9201-412b-a381-38e5f288285a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:04.590367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db87a59b-9201-412b-a381-38e5f288285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:04.591328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:04.592007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.592354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.592692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.593704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:04.594077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:04.596370 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:04.610837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 68/123] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:04.610837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.695818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 56/124] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:04.697045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87a59b-9201-412b-a381-38e5f288285a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.727100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa32725-175e-4212-baac-919ce93c2d0e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.757628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:04.760150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:04.796018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5fd7d-de60-4acd-a0f2-bc9af693c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:04.796661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5fd7d-de60-4acd-a0f2-bc9af693c523 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.796945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5fd7d-de60-4acd-a0f2-bc9af693c523 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.797258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5fd7d-de60-4acd-a0f2-bc9af693c523 None admin] PATH_INFO: `/v3/users/c9d20f523caa4aca808612f9ede7fc85` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.803456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5fd7d-de60-4acd-a0f2-bc9af693c523 None admin] RBAC: Authorizing `identity:get_user(user_id=c9d20f523caa4aca808612f9ede7fc85)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:04.805075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5fd7d-de60-4acd-a0f2-bc9af693c523 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:04.807081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 69/125] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:04 2022] GET /identity/v3/users/c9d20f523caa4aca808612f9ede7fc85 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:04.808060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5fd7d-de60-4acd-a0f2-bc9af693c523 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.815061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87a59b-9201-412b-a381-38e5f288285a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.852817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a8544-321f-44bb-a381-fe4b9cca7098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:04.854457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8544-321f-44bb-a381-fe4b9cca7098 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:04.854939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8544-321f-44bb-a381-fe4b9cca7098 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:04.855383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8544-321f-44bb-a381-fe4b9cca7098 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:04.856786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a8544-321f-44bb-a381-fe4b9cca7098 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:04.858421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a8544-321f-44bb-a381-fe4b9cca7098 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:04.860314 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 57/126] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:04 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:04.861253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a8544-321f-44bb-a381-fe4b9cca7098 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:04.980703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a8544-321f-44bb-a381-fe4b9cca7098 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:04.990815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5fd7d-de60-4acd-a0f2-bc9af693c523 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:05.005489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:05.023725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf820e9-0445-4376-b214-e6e302a39c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.024638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf820e9-0445-4376-b214-e6e302a39c27 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.025217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf820e9-0445-4376-b214-e6e302a39c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.025667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf820e9-0445-4376-b214-e6e302a39c27 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.027035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf820e9-0445-4376-b214-e6e302a39c27 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:05.028931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf820e9-0445-4376-b214-e6e302a39c27 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:05.031167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 58/127] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:04 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:05.032092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf820e9-0445-4376-b214-e6e302a39c27 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:05.051999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1876f-a549-45d8-a0e6-6aa630debd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.052696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1876f-a549-45d8-a0e6-6aa630debd9d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.053061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1876f-a549-45d8-a0e6-6aa630debd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.053402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1876f-a549-45d8-a0e6-6aa630debd9d None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.054600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1876f-a549-45d8-a0e6-6aa630debd9d None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:05.056261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1876f-a549-45d8-a0e6-6aa630debd9d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:05.062975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 70/128] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:04 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:05.063912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1876f-a549-45d8-a0e6-6aa630debd9d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:05.127751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:05.155334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf820e9-0445-4376-b214-e6e302a39c27 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:05.176129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1876f-a549-45d8-a0e6-6aa630debd9d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:05.198001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443ff8-3451-4eca-b1d2-982630fa7066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.199291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443ff8-3451-4eca-b1d2-982630fa7066 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.199571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443ff8-3451-4eca-b1d2-982630fa7066 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.199843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443ff8-3451-4eca-b1d2-982630fa7066 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/users/6658db19c88f4761aa337219a7f426b5/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.202829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3443ff8-3451-4eca-b1d2-982630fa7066 None admin] RBAC: Authorizing `identity:create_grant(project_id=e164e07e8ca44deda27ca9b205c2a48a, user_id=6658db19c88f4761aa337219a7f426b5, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:05.204274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3443ff8-3451-4eca-b1d2-982630fa7066 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:05.217381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a40658-fa9b-4a1b-be60-6a327b4eaf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.218354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a40658-fa9b-4a1b-be60-6a327b4eaf01 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.218920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a40658-fa9b-4a1b-be60-6a327b4eaf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.219457 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a40658-fa9b-4a1b-be60-6a327b4eaf01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.222871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 59/129] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:05 2022] PUT /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/users/6658db19c88f4761aa337219a7f426b5/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:05.222871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443ff8-3451-4eca-b1d2-982630fa7066 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:05.245850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a40658-fa9b-4a1b-be60-6a327b4eaf01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e3a40658-fa9b-4a1b-be60-6a327b4eaf01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:05.252309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:05.253355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:05.254119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:05.256596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 71/130] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:05.257889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a40658-fa9b-4a1b-be60-6a327b4eaf01 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:05.299211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:05.345444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443ff8-3451-4eca-b1d2-982630fa7066 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:05.387090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acb5c7-4eaf-4e59-b21e-dff2d9d9692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.387779 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acb5c7-4eaf-4e59-b21e-dff2d9d9692e None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.388249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acb5c7-4eaf-4e59-b21e-dff2d9d9692e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.388447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acb5c7-4eaf-4e59-b21e-dff2d9d9692e None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/users/c9d20f523caa4aca808612f9ede7fc85/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.391001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acb5c7-4eaf-4e59-b21e-dff2d9d9692e None admin] RBAC: Authorizing `identity:create_grant(project_id=e164e07e8ca44deda27ca9b205c2a48a, user_id=c9d20f523caa4aca808612f9ede7fc85, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:05.393507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acb5c7-4eaf-4e59-b21e-dff2d9d9692e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:05.399397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a40658-fa9b-4a1b-be60-6a327b4eaf01 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:05.413539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 60/131] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:05 2022] PUT /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/users/c9d20f523caa4aca808612f9ede7fc85/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:05.414619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acb5c7-4eaf-4e59-b21e-dff2d9d9692e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:05.445861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:05.473625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9a3b8-945a-4b23-8ece-00011cd414a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.474274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9a3b8-945a-4b23-8ece-00011cd414a5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.474560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9a3b8-945a-4b23-8ece-00011cd414a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.474864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9a3b8-945a-4b23-8ece-00011cd414a5 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.476034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9a3b8-945a-4b23-8ece-00011cd414a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:05.477556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9a3b8-945a-4b23-8ece-00011cd414a5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:05.479515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 72/132] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:05 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:05.480923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b597-b8e9-4df2-8332-312514ed6e12 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.481214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b597-b8e9-4df2-8332-312514ed6e12 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.481560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b597-b8e9-4df2-8332-312514ed6e12 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.482959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 73/133] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:05.487976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260b597-b8e9-4df2-8332-312514ed6e12 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:05.588623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acb5c7-4eaf-4e59-b21e-dff2d9d9692e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:05.613535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260b597-b8e9-4df2-8332-312514ed6e12 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:05.615186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:05.651701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2b1f5-475d-4178-9f92-321f484c1bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.652678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b1f5-475d-4178-9f92-321f484c1bba None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.653158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b1f5-475d-4178-9f92-321f484c1bba None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.653649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b1f5-475d-4178-9f92-321f484c1bba None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.654521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2b1f5-475d-4178-9f92-321f484c1bba None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:05.655601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2b1f5-475d-4178-9f92-321f484c1bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:05.657227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2b1f5-475d-4178-9f92-321f484c1bba None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:05.665290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea708c-8c37-4bab-9648-383bfa66f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.666227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea708c-8c37-4bab-9648-383bfa66f992 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.666519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea708c-8c37-4bab-9648-383bfa66f992 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.666808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea708c-8c37-4bab-9648-383bfa66f992 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/users/6658db19c88f4761aa337219a7f426b5/roles/043adf092a6b422e961a0edc97df0a66` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.669066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea708c-8c37-4bab-9648-383bfa66f992 None admin] RBAC: Authorizing `identity:create_grant(project_id=e164e07e8ca44deda27ca9b205c2a48a, user_id=6658db19c88f4761aa337219a7f426b5, role_id=043adf092a6b422e961a0edc97df0a66)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:05.670252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 61/134] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:05.670928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea708c-8c37-4bab-9648-383bfa66f992 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:05.671996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d3c86-771d-41c2-b606-428f222dbe21 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.672462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d3c86-771d-41c2-b606-428f222dbe21 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.672931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d3c86-771d-41c2-b606-428f222dbe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.692446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 74/135] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:05 2022] PUT /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/users/6658db19c88f4761aa337219a7f426b5/roles/043adf092a6b422e961a0edc97df0a66 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:05.693418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea708c-8c37-4bab-9648-383bfa66f992 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:05.696601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-071d3c86-771d-41c2-b606-428f222dbe21 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:05.698246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-071d3c86-771d-41c2-b606-428f222dbe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:05.779160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:05.786143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 62/136] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:05.866213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea708c-8c37-4bab-9648-383bfa66f992 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:05.915081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95762bba-4afd-4164-bada-64b45338323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:05.916299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762bba-4afd-4164-bada-64b45338323c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:05.916765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762bba-4afd-4164-bada-64b45338323c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:05.917136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762bba-4afd-4164-bada-64b45338323c None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:05.919498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95762bba-4afd-4164-bada-64b45338323c None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:05.921199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95762bba-4afd-4164-bada-64b45338323c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:05.923418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 75/137] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:05 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:05.928560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d3c86-771d-41c2-b606-428f222dbe21 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:06.066001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:06.071429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d3c86-771d-41c2-b606-428f222dbe21 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:06.114128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf7d7b-4766-4b19-a2ea-c97b1f1f2071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:06.114784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf7d7b-4766-4b19-a2ea-c97b1f1f2071 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:06.115053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf7d7b-4766-4b19-a2ea-c97b1f1f2071 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:06.115328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf7d7b-4766-4b19-a2ea-c97b1f1f2071 None admin] PATH_INFO: `/v3/projects/c4eb6dad57544338a311f592afd53b86` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:06.116512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf7d7b-4766-4b19-a2ea-c97b1f1f2071 None admin] RBAC: Authorizing `identity:get_project(project_id=c4eb6dad57544338a311f592afd53b86)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:06.123875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf7d7b-4766-4b19-a2ea-c97b1f1f2071 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:06.125886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 63/138] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:05 2022] GET /identity/v3/projects/c4eb6dad57544338a311f592afd53b86 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:06.131882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95762bba-4afd-4164-bada-64b45338323c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:06.241872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf7d7b-4766-4b19-a2ea-c97b1f1f2071 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:06.318356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95762bba-4afd-4164-bada-64b45338323c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:06.338695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:06.373434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e6d73-de32-4935-b763-6da490bc9070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:06.374018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e6d73-de32-4935-b763-6da490bc9070 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:06.374439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e6d73-de32-4935-b763-6da490bc9070 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:06.374713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e6d73-de32-4935-b763-6da490bc9070 None admin] PATH_INFO: `/v3/projects/c4eb6dad57544338a311f592afd53b86/users/6658db19c88f4761aa337219a7f426b5/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:06.377390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e6d73-de32-4935-b763-6da490bc9070 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4eb6dad57544338a311f592afd53b86, user_id=6658db19c88f4761aa337219a7f426b5, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:06.379255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e6d73-de32-4935-b763-6da490bc9070 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:06.395769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 76/139] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:06 2022] PUT /identity/v3/projects/c4eb6dad57544338a311f592afd53b86/users/6658db19c88f4761aa337219a7f426b5/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:06.456280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf7d7b-4766-4b19-a2ea-c97b1f1f2071 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:06.495364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a983f-96ce-4ed5-ac20-f10602e6a87c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:06.495698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a983f-96ce-4ed5-ac20-f10602e6a87c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:06.495914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a983f-96ce-4ed5-ac20-f10602e6a87c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:06.498535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 77/140] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:06.510208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520ffc-e4ae-42f0-a217-2d85854c2091 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:06.510528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520ffc-e4ae-42f0-a217-2d85854c2091 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:06.510776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520ffc-e4ae-42f0-a217-2d85854c2091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:06.513505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8e8a4-6b8a-4b68-a297-67aa1a90deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:06.514155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e8a4-6b8a-4b68-a297-67aa1a90deaf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:06.514438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e8a4-6b8a-4b68-a297-67aa1a90deaf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:06.514714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e8a4-6b8a-4b68-a297-67aa1a90deaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:06.515867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8e8a4-6b8a-4b68-a297-67aa1a90deaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:06.517307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8e8a4-6b8a-4b68-a297-67aa1a90deaf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:06.519405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 64/141] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:06.525201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8e8a4-6b8a-4b68-a297-67aa1a90deaf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:06.548648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9e520ffc-e4ae-42f0-a217-2d85854c2091 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:06.550310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9e520ffc-e4ae-42f0-a217-2d85854c2091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:06.625156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:06.658769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 78/142] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:06.741447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8e8a4-6b8a-4b68-a297-67aa1a90deaf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:06.782332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30573ab-490b-4d83-90e6-098e8c011325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:06.782991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30573ab-490b-4d83-90e6-098e8c011325 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:06.783276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30573ab-490b-4d83-90e6-098e8c011325 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:06.783613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30573ab-490b-4d83-90e6-098e8c011325 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:06.784297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30573ab-490b-4d83-90e6-098e8c011325 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:06.785786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30573ab-490b-4d83-90e6-098e8c011325 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:06.814911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 65/143] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:06 2022] POST /identity/v3/users => generated 283 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:47:07.044259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e520ffc-e4ae-42f0-a217-2d85854c2091 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:07.160476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e520ffc-e4ae-42f0-a217-2d85854c2091 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:07.171066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:07.215497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ba9cd-4186-404d-bc49-b6c40102c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:07.216150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ba9cd-4186-404d-bc49-b6c40102c93e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:07.216435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ba9cd-4186-404d-bc49-b6c40102c93e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:07.216708 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ba9cd-4186-404d-bc49-b6c40102c93e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:07.227717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ba9cd-4186-404d-bc49-b6c40102c93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-f74ba9cd-4186-404d-bc49-b6c40102c93e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:07.232854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:07.233765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:07.234646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 79/144] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:07.239808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30573ab-490b-4d83-90e6-098e8c011325 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:07.341847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:07.351137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30573ab-490b-4d83-90e6-098e8c011325 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:07.388270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:07.388883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:07.389165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:07.389439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:07.390111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:07.390416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:07.391813 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:07.401457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 66/145] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:07.407024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ba9cd-4186-404d-bc49-b6c40102c93e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:07.511432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ba9cd-4186-404d-bc49-b6c40102c93e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:07.546646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043d3c0-8533-4b2c-ae44-09ba909d2694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:07.547303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d3c0-8533-4b2c-ae44-09ba909d2694 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:07.547579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d3c0-8533-4b2c-ae44-09ba909d2694 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:07.547850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d3c0-8533-4b2c-ae44-09ba909d2694 None admin] PATH_INFO: `/v3/users/55702b8a00264879b560e447d2694364` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:07.548994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043d3c0-8533-4b2c-ae44-09ba909d2694 None admin] RBAC: Authorizing `identity:get_user(user_id=55702b8a00264879b560e447d2694364)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:07.550453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043d3c0-8533-4b2c-ae44-09ba909d2694 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:07.552062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 80/146] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:07 2022] GET /identity/v3/users/55702b8a00264879b560e447d2694364 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:07.557674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:07.661691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7cf2c-715e-48a4-82f0-3220274353d9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:07.697319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a2c6-d353-480c-867d-9e759ca3ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:07.697965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a2c6-d353-480c-867d-9e759ca3ff01 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:07.698246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a2c6-d353-480c-867d-9e759ca3ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:07.698523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a2c6-d353-480c-867d-9e759ca3ff01 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:07.699714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a2c6-d353-480c-867d-9e759ca3ff01 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:07.701155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a2c6-d353-480c-867d-9e759ca3ff01 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:07.702816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 67/147] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:07 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:07.708600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043d3c0-8533-4b2c-ae44-09ba909d2694 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:07.745395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:07.816216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043d3c0-8533-4b2c-ae44-09ba909d2694 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:07.852770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f0a53-1da5-4b1c-903c-8cb6558657ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:07.853604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f0a53-1da5-4b1c-903c-8cb6558657ce None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:07.853886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f0a53-1da5-4b1c-903c-8cb6558657ce None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:07.854155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f0a53-1da5-4b1c-903c-8cb6558657ce None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/users/55702b8a00264879b560e447d2694364/roles/68ce6057586947a4abce25fb4a5752ab` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:07.856172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f0a53-1da5-4b1c-903c-8cb6558657ce None admin] RBAC: Authorizing `identity:create_grant(project_id=e164e07e8ca44deda27ca9b205c2a48a, user_id=55702b8a00264879b560e447d2694364, role_id=68ce6057586947a4abce25fb4a5752ab)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:07.857623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f0a53-1da5-4b1c-903c-8cb6558657ce None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:07.874153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 81/148] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:07 2022] PUT /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/users/55702b8a00264879b560e447d2694364/roles/68ce6057586947a4abce25fb4a5752ab => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:08.511369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38e02-202e-4ed2-8615-e751fe3177f2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:08.511763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38e02-202e-4ed2-8615-e751fe3177f2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:08.511937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38e02-202e-4ed2-8615-e751fe3177f2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:08.513277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 68/149] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:08.518794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ca854-1f2b-403a-8e3e-eea54f677a77 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:08.519267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ca854-1f2b-403a-8e3e-eea54f677a77 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:08.519348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ca854-1f2b-403a-8e3e-eea54f677a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:08.543199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c86ca854-1f2b-403a-8e3e-eea54f677a77 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:08.544419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c86ca854-1f2b-403a-8e3e-eea54f677a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:08.628347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 82/150] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:08.946802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4999-abf7-40c2-a309-69b82de19d76 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:08.947414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4999-abf7-40c2-a309-69b82de19d76 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:08.947414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4999-abf7-40c2-a309-69b82de19d76 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:08.948763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 69/151] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:08.967368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c8fe-ece2-4730-aa1e-28bbaf090d88 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:08.967696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c8fe-ece2-4730-aa1e-28bbaf090d88 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:08.967919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c8fe-ece2-4730-aa1e-28bbaf090d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:08.991203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c4826-8bff-4809-b6b7-d32935de72a2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:08.991494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c4826-8bff-4809-b6b7-d32935de72a2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:08.991758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c4826-8bff-4809-b6b7-d32935de72a2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:08.993103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 70/152] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:08.995806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dc61c8fe-ece2-4730-aa1e-28bbaf090d88 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:08.997111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dc61c8fe-ece2-4730-aa1e-28bbaf090d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:08.998524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3303-c9b6-422c-b2aa-e82f5ee48ca0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:08.998843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3303-c9b6-422c-b2aa-e82f5ee48ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:08.999127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3303-c9b6-422c-b2aa-e82f5ee48ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:09.021464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fa2c3303-c9b6-422c-b2aa-e82f5ee48ca0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:09.022679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fa2c3303-c9b6-422c-b2aa-e82f5ee48ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:09.023880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:09.046059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:09.103034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 71/153] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:09.144819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 83/154] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:09.187780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3303-c9b6-422c-b2aa-e82f5ee48ca0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:09.319255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3303-c9b6-422c-b2aa-e82f5ee48ca0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:09.354896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f0249-5aee-4e70-8efa-0d944e02a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:09.355537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f0249-5aee-4e70-8efa-0d944e02a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:09.355812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f0249-5aee-4e70-8efa-0d944e02a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:09.356081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f0249-5aee-4e70-8efa-0d944e02a6c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:09.366908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f0249-5aee-4e70-8efa-0d944e02a6c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-910f0249-5aee-4e70-8efa-0d944e02a6c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:09.372426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:09.373527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:09.374269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 72/155] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:09.379896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61c8fe-ece2-4730-aa1e-28bbaf090d88 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:09.506607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61c8fe-ece2-4730-aa1e-28bbaf090d88 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:09.542633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:09.543449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:09.543601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:09.543791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:09.544461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:09.544759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:09.546155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:09.554929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 84/156] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:09.560656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f0249-5aee-4e70-8efa-0d944e02a6c9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:09.582368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:09.616215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:09.652531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:09.700108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f0249-5aee-4e70-8efa-0d944e02a6c9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:09.740344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fab54-6a7a-48d0-819e-a34b84e3427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:09.740988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fab54-6a7a-48d0-819e-a34b84e3427e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:09.741269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fab54-6a7a-48d0-819e-a34b84e3427e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:09.741543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fab54-6a7a-48d0-819e-a34b84e3427e None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:09.742769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fab54-6a7a-48d0-819e-a34b84e3427e None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:09.744333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fab54-6a7a-48d0-819e-a34b84e3427e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:09.747050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 73/157] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:09 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:09.747715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fab54-6a7a-48d0-819e-a34b84e3427e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:09.862320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fab54-6a7a-48d0-819e-a34b84e3427e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:09.885022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:09.887288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e4af0-e672-4470-90a9-2cf5dc4a4e06 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:09.915067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7eb93-9cd2-412f-88a6-3275e4e84099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:09.915918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7eb93-9cd2-412f-88a6-3275e4e84099 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:09.916115 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7eb93-9cd2-412f-88a6-3275e4e84099 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:09.916346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7eb93-9cd2-412f-88a6-3275e4e84099 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:09.935306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7eb93-9cd2-412f-88a6-3275e4e84099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3ed7eb93-9cd2-412f-88a6-3275e4e84099 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:09.940497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:09.941454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:09.942231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 74/158] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:09.942906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7eb93-9cd2-412f-88a6-3275e4e84099 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:09.986347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42668f42-4d24-467d-b4bf-d2639b5fc244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:09.987471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42668f42-4d24-467d-b4bf-d2639b5fc244 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:09.987942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42668f42-4d24-467d-b4bf-d2639b5fc244 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:09.988402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42668f42-4d24-467d-b4bf-d2639b5fc244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:10.006122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42668f42-4d24-467d-b4bf-d2639b5fc244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-42668f42-4d24-467d-b4bf-d2639b5fc244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:10.018715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:10.019658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:10.020529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:10.023128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 85/159] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:10.024188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42668f42-4d24-467d-b4bf-d2639b5fc244 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:10.112742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7eb93-9cd2-412f-88a6-3275e4e84099 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:10.165174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c52c46-5814-417e-8403-cd6ffef163f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:10.165174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c52c46-5814-417e-8403-cd6ffef163f4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:10.165174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c52c46-5814-417e-8403-cd6ffef163f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:10.165174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c52c46-5814-417e-8403-cd6ffef163f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:10.195178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:10.200112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:10.230576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42668f42-4d24-467d-b4bf-d2639b5fc244 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:10.286562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:10.287357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:10.287732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:10.288383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:10.288924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:10.289323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:10.291404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:10.299971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 86/160] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:10.300938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:10.318324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c52c46-5814-417e-8403-cd6ffef163f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:10.324020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c52c46-5814-417e-8403-cd6ffef163f4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:10.405869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32b52-8965-4ef4-b9d2-09ada6c323b8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:10.441197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:10.441983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:10.442365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:10.442737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:10.443601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:10.444061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:10.445662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:10.455992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 87/161] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:10.456904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:10.463357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:10.548192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 75/162] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:10.549471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e5606-bd13-42d3-a72a-9aeb21bb9088 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:10.549748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e5606-bd13-42d3-a72a-9aeb21bb9088 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:10.550013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e5606-bd13-42d3-a72a-9aeb21bb9088 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:10.551276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 76/163] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:10.551960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e5606-bd13-42d3-a72a-9aeb21bb9088 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:10.621044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb81a79-c23c-4f1b-be96-c74b7d2f6fec None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:10.644825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:10.727464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b3a62-f8be-4258-99ea-cf55ec598531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:10.728565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b3a62-f8be-4258-99ea-cf55ec598531 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:10.729049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b3a62-f8be-4258-99ea-cf55ec598531 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:10.729528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b3a62-f8be-4258-99ea-cf55ec598531 None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:10.730920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b3a62-f8be-4258-99ea-cf55ec598531 None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:10.732578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b3a62-f8be-4258-99ea-cf55ec598531 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:10.734505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 88/164] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:10 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:10.736903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644186b-7173-420a-9cb2-a744d3ce7135 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:10.737405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644186b-7173-420a-9cb2-a744d3ce7135 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:10.737889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644186b-7173-420a-9cb2-a744d3ce7135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:10.776158 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b644186b-7173-420a-9cb2-a744d3ce7135 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:10.777834 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b644186b-7173-420a-9cb2-a744d3ce7135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:10.778069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e5606-bd13-42d3-a72a-9aeb21bb9088 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:10.863437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92cbeb-becf-4e0e-8d18-ad72c5411ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:10.864089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cbeb-becf-4e0e-8d18-ad72c5411ece None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:10.864363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cbeb-becf-4e0e-8d18-ad72c5411ece None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:10.864631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cbeb-becf-4e0e-8d18-ad72c5411ece None admin] PATH_INFO: `/v3/users/c9d20f523caa4aca808612f9ede7fc85` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:10.867493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92cbeb-becf-4e0e-8d18-ad72c5411ece None admin] RBAC: Authorizing `identity:get_user(user_id=c9d20f523caa4aca808612f9ede7fc85)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:10.869590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92cbeb-becf-4e0e-8d18-ad72c5411ece None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:10.871432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 77/165] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:10 2022] GET /identity/v3/users/c9d20f523caa4aca808612f9ede7fc85 => generated 247 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:10.871991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92cbeb-becf-4e0e-8d18-ad72c5411ece None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:10.879598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:10.896439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 89/166] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:10.897313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644186b-7173-420a-9cb2-a744d3ce7135 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:11.029098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92cbeb-becf-4e0e-8d18-ad72c5411ece None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:11.039078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:11.066473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a96c3a-6a97-4562-ae75-deeebc307311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:11.067232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a96c3a-6a97-4562-ae75-deeebc307311 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:11.067596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a96c3a-6a97-4562-ae75-deeebc307311 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:11.067938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a96c3a-6a97-4562-ae75-deeebc307311 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:11.069193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a96c3a-6a97-4562-ae75-deeebc307311 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:11.070627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a96c3a-6a97-4562-ae75-deeebc307311 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:11.073018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 78/167] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:10 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:11.073797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a96c3a-6a97-4562-ae75-deeebc307311 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:11.079466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644186b-7173-420a-9cb2-a744d3ce7135 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:11.167461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0a844-98a5-4873-9efe-a9ef284ac758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:11.168083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a844-98a5-4873-9efe-a9ef284ac758 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:11.168359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a844-98a5-4873-9efe-a9ef284ac758 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:11.168626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a844-98a5-4873-9efe-a9ef284ac758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:11.264748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a96c3a-6a97-4562-ae75-deeebc307311 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:11.299981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:11.304606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0a844-98a5-4873-9efe-a9ef284ac758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:11.306453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0a844-98a5-4873-9efe-a9ef284ac758 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:11.382779 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505c5dc-1899-42c6-9ba0-c4b089df0419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:11.383426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505c5dc-1899-42c6-9ba0-c4b089df0419 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:11.383699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505c5dc-1899-42c6-9ba0-c4b089df0419 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:11.384069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505c5dc-1899-42c6-9ba0-c4b089df0419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:11.430591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 90/168] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:11.432020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0a844-98a5-4873-9efe-a9ef284ac758 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:11.456772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:11.489868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505c5dc-1899-42c6-9ba0-c4b089df0419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:11.491458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505c5dc-1899-42c6-9ba0-c4b089df0419 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:11.538135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0a844-98a5-4873-9efe-a9ef284ac758 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:11.547141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:11.576709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:11.577555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:11.577995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:11.578407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:11.579317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] RBAC: Adding query filter params (role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a, user.id=6658db19c88f4761aa337219a7f426b5) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:11.579769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:11.581336 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:11.588008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 91/169] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:11 2022] GET /identity/v3/role_assignments?user.id=6658db19c88f4761aa337219a7f426b5&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:11.589008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:11.700422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f989-9570-4946-929d-769e601b0239 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:11.738334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 79/170] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:11.742778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505c5dc-1899-42c6-9ba0-c4b089df0419 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:11.744987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0761-6344-4aea-85cd-f8ee09608ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:11.745848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0761-6344-4aea-85cd-f8ee09608ecf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:11.746301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0761-6344-4aea-85cd-f8ee09608ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:11.746775 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0761-6344-4aea-85cd-f8ee09608ecf None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:11.751590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0761-6344-4aea-85cd-f8ee09608ecf None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:11.753458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0761-6344-4aea-85cd-f8ee09608ecf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:11.755438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 92/171] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:11 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:11.756392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0761-6344-4aea-85cd-f8ee09608ecf None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:11.789998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:11.872160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0761-6344-4aea-85cd-f8ee09608ecf None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:11.923400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83874b-e42e-4052-bb80-b0c6bf0e3b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:11.924377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83874b-e42e-4052-bb80-b0c6bf0e3b70 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:11.924835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83874b-e42e-4052-bb80-b0c6bf0e3b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:11.925284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83874b-e42e-4052-bb80-b0c6bf0e3b70 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:11.929142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83874b-e42e-4052-bb80-b0c6bf0e3b70 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:11.931092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83874b-e42e-4052-bb80-b0c6bf0e3b70 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:11.931635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:11.940721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 93/172] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:11 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:11.942798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83874b-e42e-4052-bb80-b0c6bf0e3b70 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:11.989543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505c5dc-1899-42c6-9ba0-c4b089df0419 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:12.074952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81248dae-c4e3-46bf-9bc1-70cadbc844ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:12.075591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248dae-c4e3-46bf-9bc1-70cadbc844ae None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.075862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248dae-c4e3-46bf-9bc1-70cadbc844ae None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.076127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248dae-c4e3-46bf-9bc1-70cadbc844ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.089466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81248dae-c4e3-46bf-9bc1-70cadbc844ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-81248dae-c4e3-46bf-9bc1-70cadbc844ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:12.095079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:12.096151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:12.097145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 80/173] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:12.097895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81248dae-c4e3-46bf-9bc1-70cadbc844ae None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:12.122344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:12.127068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83874b-e42e-4052-bb80-b0c6bf0e3b70 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:12.164948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7539ca0-f951-4080-a16d-274ab3f241c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:12.165646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539ca0-f951-4080-a16d-274ab3f241c8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.165884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539ca0-f951-4080-a16d-274ab3f241c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.166155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539ca0-f951-4080-a16d-274ab3f241c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.166905 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7539ca0-f951-4080-a16d-274ab3f241c8 None admin] RBAC: Adding query filter params (role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a, user.id=6658db19c88f4761aa337219a7f426b5) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:12.167209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7539ca0-f951-4080-a16d-274ab3f241c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:12.168653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7539ca0-f951-4080-a16d-274ab3f241c8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:12.175030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 94/174] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:11 2022] GET /identity/v3/role_assignments?user.id=6658db19c88f4761aa337219a7f426b5&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=043adf092a6b422e961a0edc97df0a66 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:12.176285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994b93-d19f-495a-a455-940d42af3373 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.176569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994b93-d19f-495a-a455-940d42af3373 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.176837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994b93-d19f-495a-a455-940d42af3373 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.178025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 95/175] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:12.178714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58994b93-d19f-495a-a455-940d42af3373 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:12.258432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81248dae-c4e3-46bf-9bc1-70cadbc844ae None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:12.336186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf5d26-410f-4703-90eb-f7ee40cf154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:12.336825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf5d26-410f-4703-90eb-f7ee40cf154a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.337891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf5d26-410f-4703-90eb-f7ee40cf154a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.338257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf5d26-410f-4703-90eb-f7ee40cf154a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.340426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf5d26-410f-4703-90eb-f7ee40cf154a None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a, user.id=c9d20f523caa4aca808612f9ede7fc85) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:12.340740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf5d26-410f-4703-90eb-f7ee40cf154a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:12.342208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf5d26-410f-4703-90eb-f7ee40cf154a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:12.352234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:12.358879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 81/176] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:12 2022] GET /identity/v3/role_assignments?user.id=c9d20f523caa4aca808612f9ede7fc85&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:12.360206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae23da-549a-4a27-8122-e7f2de3694a7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.360483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae23da-549a-4a27-8122-e7f2de3694a7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.360749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae23da-549a-4a27-8122-e7f2de3694a7 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.362472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 82/177] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:12.363645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0626ec-aca9-457b-ac09-a1a318d23147 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.363923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0626ec-aca9-457b-ac09-a1a318d23147 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.364190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0626ec-aca9-457b-ac09-a1a318d23147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.397054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58994b93-d19f-495a-a455-940d42af3373 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:12.414634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ee0626ec-aca9-457b-ac09-a1a318d23147 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:12.419648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ee0626ec-aca9-457b-ac09-a1a318d23147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:12.484561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7050af-1ef8-4457-a086-cee98a8f9db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:12.485967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7050af-1ef8-4457-a086-cee98a8f9db7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.486249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7050af-1ef8-4457-a086-cee98a8f9db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.486520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7050af-1ef8-4457-a086-cee98a8f9db7 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.487254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7050af-1ef8-4457-a086-cee98a8f9db7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:12.487562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7050af-1ef8-4457-a086-cee98a8f9db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:12.489010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7050af-1ef8-4457-a086-cee98a8f9db7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:12.503209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 96/178] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:12.504885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7090b7-dd0a-48f1-a90e-386457fa67bf None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.505169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7090b7-dd0a-48f1-a90e-386457fa67bf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.505440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7090b7-dd0a-48f1-a90e-386457fa67bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.532647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ff7090b7-dd0a-48f1-a90e-386457fa67bf None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:12.533818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ff7090b7-dd0a-48f1-a90e-386457fa67bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:12.546363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 83/179] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:12.547311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0626ec-aca9-457b-ac09-a1a318d23147 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:12.565306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:12.654070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 97/180] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:12.655373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7842a-c34b-488d-afb4-00f53369caf8 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.655907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7842a-c34b-488d-afb4-00f53369caf8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.656353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7842a-c34b-488d-afb4-00f53369caf8 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.657815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 98/181] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:12.664363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015759-3748-480e-bf1c-960b5337e0aa None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.664955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015759-3748-480e-bf1c-960b5337e0aa None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.666444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015759-3748-480e-bf1c-960b5337e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.698425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1e015759-3748-480e-bf1c-960b5337e0aa None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:12.699925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1e015759-3748-480e-bf1c-960b5337e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:12.713329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0626ec-aca9-457b-ac09-a1a318d23147 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:12.751732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:12.762083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c1f6a-cd4e-4d94-9176-7cfb072b9c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:12.763138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1f6a-cd4e-4d94-9176-7cfb072b9c75 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.763647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1f6a-cd4e-4d94-9176-7cfb072b9c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.764117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1f6a-cd4e-4d94-9176-7cfb072b9c75 None admin] PATH_INFO: `/v3/users/6658db19c88f4761aa337219a7f426b5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.765687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1f6a-cd4e-4d94-9176-7cfb072b9c75 None admin] RBAC: Authorizing `identity:get_user(user_id=6658db19c88f4761aa337219a7f426b5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:12.768086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1f6a-cd4e-4d94-9176-7cfb072b9c75 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:12.770365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 84/182] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:12 2022] GET /identity/v3/users/6658db19c88f4761aa337219a7f426b5 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:12.772004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06655b9c-98e6-4af1-97ee-5bc03531987f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.772479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06655b9c-98e6-4af1-97ee-5bc03531987f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.772937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06655b9c-98e6-4af1-97ee-5bc03531987f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.774611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 85/183] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:12.778874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06655b9c-98e6-4af1-97ee-5bc03531987f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:12.782296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 99/184] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:12.783949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e215187-f961-4d4d-8e6b-e6e744443c1e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.784234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e215187-f961-4d4d-8e6b-e6e744443c1e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.784508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e215187-f961-4d4d-8e6b-e6e744443c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:12.803246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2e215187-f961-4d4d-8e6b-e6e744443c1e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:12.804425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2e215187-f961-4d4d-8e6b-e6e744443c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:12.884503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 100/185] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:12.908750 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06655b9c-98e6-4af1-97ee-5bc03531987f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:12.944816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139de9e-22bc-41e4-ae2d-a07b9e6b6d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:12.945424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139de9e-22bc-41e4-ae2d-a07b9e6b6d3e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:12.945694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139de9e-22bc-41e4-ae2d-a07b9e6b6d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:12.945959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139de9e-22bc-41e4-ae2d-a07b9e6b6d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.007406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e215187-f961-4d4d-8e6b-e6e744443c1e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.034446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.036661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.041295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139de9e-22bc-41e4-ae2d-a07b9e6b6d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.043024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139de9e-22bc-41e4-ae2d-a07b9e6b6d3e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:13.146021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e215187-f961-4d4d-8e6b-e6e744443c1e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.148340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 86/186] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:13.153276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139de9e-22bc-41e4-ae2d-a07b9e6b6d3e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.189115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92438e21-3eff-4eb9-b9d0-15e7fdf3f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.189667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92438e21-3eff-4eb9-b9d0-15e7fdf3f1fa None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.189940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92438e21-3eff-4eb9-b9d0-15e7fdf3f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.190209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92438e21-3eff-4eb9-b9d0-15e7fdf3f1fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.200905 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92438e21-3eff-4eb9-b9d0-15e7fdf3f1fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-92438e21-3eff-4eb9-b9d0-15e7fdf3f1fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:13.205756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:13.207335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 101/187] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:13.208238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92438e21-3eff-4eb9-b9d0-15e7fdf3f1fa None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.251753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.255444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139de9e-22bc-41e4-ae2d-a07b9e6b6d3e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.285375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.292269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6096c-8910-47c4-bb12-63bb21b205fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.292905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6096c-8910-47c4-bb12-63bb21b205fd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.293180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6096c-8910-47c4-bb12-63bb21b205fd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.293448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6096c-8910-47c4-bb12-63bb21b205fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.303448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6096c-8910-47c4-bb12-63bb21b205fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-50c6096c-8910-47c4-bb12-63bb21b205fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:13.308266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:13.309219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:13.310029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 87/188] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:13.310671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6096c-8910-47c4-bb12-63bb21b205fd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.310873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92438e21-3eff-4eb9-b9d0-15e7fdf3f1fa None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.344980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395190ae-c8a8-42c0-a133-f7379d9fd5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.345616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395190ae-c8a8-42c0-a133-f7379d9fd5db None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.345879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395190ae-c8a8-42c0-a133-f7379d9fd5db None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.346147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395190ae-c8a8-42c0-a133-f7379d9fd5db None admin] PATH_INFO: `/v3/projects/c4eb6dad57544338a311f592afd53b86` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.347323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395190ae-c8a8-42c0-a133-f7379d9fd5db None admin] RBAC: Authorizing `identity:get_project(project_id=c4eb6dad57544338a311f592afd53b86)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.348776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395190ae-c8a8-42c0-a133-f7379d9fd5db None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:13.350383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 102/189] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/projects/c4eb6dad57544338a311f592afd53b86 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:13.356004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395190ae-c8a8-42c0-a133-f7379d9fd5db None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.412897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6096c-8910-47c4-bb12-63bb21b205fd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.445634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a00a6-3dc8-41d3-a47d-40dc389e6374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.446183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a00a6-3dc8-41d3-a47d-40dc389e6374 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.446981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a00a6-3dc8-41d3-a47d-40dc389e6374 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.447254 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a00a6-3dc8-41d3-a47d-40dc389e6374 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.448438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a00a6-3dc8-41d3-a47d-40dc389e6374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.449872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a00a6-3dc8-41d3-a47d-40dc389e6374 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:13.451463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 88/190] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:13.452981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395190ae-c8a8-42c0-a133-f7379d9fd5db None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.455038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a00a6-3dc8-41d3-a47d-40dc389e6374 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.482154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.486745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.487362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.487641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.487912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.488568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:13.488865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.490227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:13.498325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 103/191] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:13.499138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.504210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.556244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a00a6-3dc8-41d3-a47d-40dc389e6374 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.590397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae13cb-67ec-495f-9c6f-fe03de80fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.591120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae13cb-67ec-495f-9c6f-fe03de80fef8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.591402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae13cb-67ec-495f-9c6f-fe03de80fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.591671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae13cb-67ec-495f-9c6f-fe03de80fef8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.596826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181432df-2a69-42cb-b95d-6f1a8870b29a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.602336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae13cb-67ec-495f-9c6f-fe03de80fef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6aae13cb-67ec-495f-9c6f-fe03de80fef8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:13.607140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:13.608177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 89/192] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:13.609177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae13cb-67ec-495f-9c6f-fe03de80fef8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.633629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.634483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.634897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.635174 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.635896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:13.636196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.637561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:13.645340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 104/193] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:13.646123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.703198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.710459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.719131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae13cb-67ec-495f-9c6f-fe03de80fef8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.745565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0346fa-42e5-44f3-bce9-4df5dfbe26f5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.752423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.753193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.753471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.753744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.754473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] RBAC: Adding query filter params (role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=c4eb6dad57544338a311f592afd53b86, user.id=6658db19c88f4761aa337219a7f426b5) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:13.754807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.756280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:13.762015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 90/194] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/role_assignments?user.id=6658db19c88f4761aa337219a7f426b5&scope.project.id=c4eb6dad57544338a311f592afd53b86&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:13.762809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.780465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf53c2-c4e9-4eb8-8cc9-7b2dd5aeff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.781097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf53c2-c4e9-4eb8-8cc9-7b2dd5aeff11 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.781428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf53c2-c4e9-4eb8-8cc9-7b2dd5aeff11 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.781702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf53c2-c4e9-4eb8-8cc9-7b2dd5aeff11 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.782544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf53c2-c4e9-4eb8-8cc9-7b2dd5aeff11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.784252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf53c2-c4e9-4eb8-8cc9-7b2dd5aeff11 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:13.809414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 105/195] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:13 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:47:13.810267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf53c2-c4e9-4eb8-8cc9-7b2dd5aeff11 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.908602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def388e7-a2d4-4d00-812c-68a82030614d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.943415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf53c2-c4e9-4eb8-8cc9-7b2dd5aeff11 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:13.978011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:13.980063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d07e-8049-4d0c-8a10-aabef4266d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.980762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d07e-8049-4d0c-8a10-aabef4266d5a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.981038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d07e-8049-4d0c-8a10-aabef4266d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.981347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d07e-8049-4d0c-8a10-aabef4266d5a None admin] PATH_INFO: `/v3/users/55702b8a00264879b560e447d2694364` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.982617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487d07e-8049-4d0c-8a10-aabef4266d5a None admin] RBAC: Authorizing `identity:get_user(user_id=55702b8a00264879b560e447d2694364)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.984141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487d07e-8049-4d0c-8a10-aabef4266d5a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:13.985969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 91/196] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/users/55702b8a00264879b560e447d2694364 => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:13.986556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d07e-8049-4d0c-8a10-aabef4266d5a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:13.993382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:13.994003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:13.994454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:13.995011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:13.995852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:13.996425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:13.997829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:14.009700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 106/197] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:14.010811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:14.018047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:14.120897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d07e-8049-4d0c-8a10-aabef4266d5a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:14.133051 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fd73a-4b37-4cae-b06d-16f8d554a766 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:14.175170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f9504-56c6-4a87-a85d-a6abc767f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:14.175783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9504-56c6-4a87-a85d-a6abc767f7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:14.176067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9504-56c6-4a87-a85d-a6abc767f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:14.176334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9504-56c6-4a87-a85d-a6abc767f7c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:14.178525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96334f-8052-4ce8-9e0c-f7a445bc967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:14.179189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96334f-8052-4ce8-9e0c-f7a445bc967c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:14.179463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96334f-8052-4ce8-9e0c-f7a445bc967c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:14.179733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96334f-8052-4ce8-9e0c-f7a445bc967c None admin] PATH_INFO: `/v3/users/b0d14631c8fb4b08979de1304cd40ba9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:14.199365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96334f-8052-4ce8-9e0c-f7a445bc967c None admin] RBAC: Authorizing `identity:get_user(user_id=b0d14631c8fb4b08979de1304cd40ba9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:14.201131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96334f-8052-4ce8-9e0c-f7a445bc967c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:14.203794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 92/198] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:13 2022] GET /identity/v3/users/b0d14631c8fb4b08979de1304cd40ba9 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:14.205067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96334f-8052-4ce8-9e0c-f7a445bc967c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:14.239367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:14.257656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f9504-56c6-4a87-a85d-a6abc767f7c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:14.260186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f9504-56c6-4a87-a85d-a6abc767f7c5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:14.307899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:14.340123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96334f-8052-4ce8-9e0c-f7a445bc967c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:14.386623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 107/199] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:14.386623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f9504-56c6-4a87-a85d-a6abc767f7c5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:14.391835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ae9ec-7224-45f3-b9d7-23d1b93bb465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:14.392636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ae9ec-7224-45f3-b9d7-23d1b93bb465 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:14.393056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ae9ec-7224-45f3-b9d7-23d1b93bb465 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:14.393986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ae9ec-7224-45f3-b9d7-23d1b93bb465 None admin] PATH_INFO: `/v3/users/b0d14631c8fb4b08979de1304cd40ba9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:14.395946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ae9ec-7224-45f3-b9d7-23d1b93bb465 None admin] RBAC: Authorizing `identity:get_user(user_id=b0d14631c8fb4b08979de1304cd40ba9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:14.398336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ae9ec-7224-45f3-b9d7-23d1b93bb465 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:14.401582 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 93/200] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:14 2022] GET /identity/v3/users/b0d14631c8fb4b08979de1304cd40ba9 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:14.402568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ae9ec-7224-45f3-b9d7-23d1b93bb465 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:14.500865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:14.505490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ae9ec-7224-45f3-b9d7-23d1b93bb465 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:14.524012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f9504-56c6-4a87-a85d-a6abc767f7c5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:14.547324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764bf4d-8000-486f-8ac2-86369129ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:14.547969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764bf4d-8000-486f-8ac2-86369129ee21 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:14.548246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764bf4d-8000-486f-8ac2-86369129ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:14.548519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764bf4d-8000-486f-8ac2-86369129ee21 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:14.549932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764bf4d-8000-486f-8ac2-86369129ee21 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:14.551414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764bf4d-8000-486f-8ac2-86369129ee21 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:14.554895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 94/201] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:14 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:14.556437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764bf4d-8000-486f-8ac2-86369129ee21 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:14.571340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e5b2-3c7a-4171-8975-49c741fa669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:14.572129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e5b2-3c7a-4171-8975-49c741fa669c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:14.572363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e5b2-3c7a-4171-8975-49c741fa669c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:14.572600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e5b2-3c7a-4171-8975-49c741fa669c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:14.595145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:14.661473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46e5b2-3c7a-4171-8975-49c741fa669c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:14.663142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46e5b2-3c7a-4171-8975-49c741fa669c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:14.676593 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764bf4d-8000-486f-8ac2-86369129ee21 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:14.714120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777aed8-a727-4dd8-96da-103f919a98b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:14.714737 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777aed8-a727-4dd8-96da-103f919a98b3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:14.715037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777aed8-a727-4dd8-96da-103f919a98b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:14.715310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777aed8-a727-4dd8-96da-103f919a98b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:14.760222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:14.778487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 108/202] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:14.783918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e5b2-3c7a-4171-8975-49c741fa669c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:14.787413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777aed8-a727-4dd8-96da-103f919a98b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:14.788887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777aed8-a727-4dd8-96da-103f919a98b3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:14.803775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:14.892219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e5b2-3c7a-4171-8975-49c741fa669c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:14.897775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 95/203] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:14.898544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777aed8-a727-4dd8-96da-103f919a98b3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:14.929178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e221-986d-4aec-9294-604455770409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:14.929880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e221-986d-4aec-9294-604455770409 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:14.930161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e221-986d-4aec-9294-604455770409 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:14.930431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e221-986d-4aec-9294-604455770409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:14.931731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985e221-986d-4aec-9294-604455770409 None admin] RBAC: Adding query filter params (role.id=68ce6057586947a4abce25fb4a5752ab, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a, user.id=55702b8a00264879b560e447d2694364) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:14.932038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985e221-986d-4aec-9294-604455770409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:14.933480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985e221-986d-4aec-9294-604455770409 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:14.946978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 109/204] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:14 2022] GET /identity/v3/role_assignments?user.id=55702b8a00264879b560e447d2694364&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=68ce6057586947a4abce25fb4a5752ab => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:14.948110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e221-986d-4aec-9294-604455770409 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:15.016688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777aed8-a727-4dd8-96da-103f919a98b3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:15.031735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:15.046350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:15.055455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f38f86-b2b3-4688-80f4-61b21fa882ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:15.057510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f38f86-b2b3-4688-80f4-61b21fa882ea None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:15.057798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f38f86-b2b3-4688-80f4-61b21fa882ea None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:15.058070 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f38f86-b2b3-4688-80f4-61b21fa882ea None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:15.059261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f38f86-b2b3-4688-80f4-61b21fa882ea None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:15.060706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f38f86-b2b3-4688-80f4-61b21fa882ea None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:15.062701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 96/205] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:14 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:15.072053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f38f86-b2b3-4688-80f4-61b21fa882ea None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:15.111599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e221-986d-4aec-9294-604455770409 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:15.150527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ce050-6202-451b-9b40-5e26e9b6a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:15.151231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce050-6202-451b-9b40-5e26e9b6a442 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:15.151506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce050-6202-451b-9b40-5e26e9b6a442 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:15.151774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce050-6202-451b-9b40-5e26e9b6a442 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:15.152962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ce050-6202-451b-9b40-5e26e9b6a442 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:15.154430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ce050-6202-451b-9b40-5e26e9b6a442 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:15.156486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 110/206] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:14 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:15.162308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ce050-6202-451b-9b40-5e26e9b6a442 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:15.234105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f38f86-b2b3-4688-80f4-61b21fa882ea None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:15.270130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ce050-6202-451b-9b40-5e26e9b6a442 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:15.275412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be4a14-0929-4262-99b7-608672e58568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:15.276290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4a14-0929-4262-99b7-608672e58568 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:15.276563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4a14-0929-4262-99b7-608672e58568 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:15.276916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4a14-0929-4262-99b7-608672e58568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:15.277676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be4a14-0929-4262-99b7-608672e58568 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=4e3eb031806d4c758fdf3846558516d7, user.id=b0d14631c8fb4b08979de1304cd40ba9) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:15.277981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be4a14-0929-4262-99b7-608672e58568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:15.279463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be4a14-0929-4262-99b7-608672e58568 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:15.286290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 97/207] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:15 2022] GET /identity/v3/role_assignments?user.id=b0d14631c8fb4b08979de1304cd40ba9&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:15.288972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:15.311571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b045c62-b69e-433c-a0ee-8dcf852feead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:15.312197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045c62-b69e-433c-a0ee-8dcf852feead None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:15.312504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045c62-b69e-433c-a0ee-8dcf852feead None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:15.312743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045c62-b69e-433c-a0ee-8dcf852feead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:15.313491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b045c62-b69e-433c-a0ee-8dcf852feead None admin] RBAC: Adding query filter params (role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=4e3eb031806d4c758fdf3846558516d7, user.id=b0d14631c8fb4b08979de1304cd40ba9) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:15.313797 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b045c62-b69e-433c-a0ee-8dcf852feead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:15.315402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b045c62-b69e-433c-a0ee-8dcf852feead None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:15.322145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 111/208] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:15 2022] GET /identity/v3/role_assignments?user.id=b0d14631c8fb4b08979de1304cd40ba9&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=043adf092a6b422e961a0edc97df0a66 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:16.223145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e474b0-b3e4-401c-9e8b-13f1261ee00f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:16.223674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e474b0-b3e4-401c-9e8b-13f1261ee00f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:16.223674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e474b0-b3e4-401c-9e8b-13f1261ee00f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:16.225301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 98/209] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:16.231026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae269-94c9-42dd-9a92-5cf164990d6f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:16.231472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae269-94c9-42dd-9a92-5cf164990d6f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:16.231652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae269-94c9-42dd-9a92-5cf164990d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:16.250302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2d8ae269-94c9-42dd-9a92-5cf164990d6f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:16.251532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2d8ae269-94c9-42dd-9a92-5cf164990d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:16.323791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 112/210] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:16.565974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5e045-abe3-4986-af08-37de56141963 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:16.566345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5e045-abe3-4986-af08-37de56141963 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:16.566543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5e045-abe3-4986-af08-37de56141963 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:16.568135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 99/211] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:16.574019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ab0c-5830-4f98-9242-3e9671372415 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:16.574301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ab0c-5830-4f98-9242-3e9671372415 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:16.574573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ab0c-5830-4f98-9242-3e9671372415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:16.593166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-53a6ab0c-5830-4f98-9242-3e9671372415 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:16.594350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-53a6ab0c-5830-4f98-9242-3e9671372415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:16.596590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5e045-abe3-4986-af08-37de56141963 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:16.668671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:16.673477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 113/212] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:16.729679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5e045-abe3-4986-af08-37de56141963 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:16.765318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36f98d-00ba-405a-93e5-94f0ca8b269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:16.765941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36f98d-00ba-405a-93e5-94f0ca8b269c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:16.766212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36f98d-00ba-405a-93e5-94f0ca8b269c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:16.766478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36f98d-00ba-405a-93e5-94f0ca8b269c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:16.777976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36f98d-00ba-405a-93e5-94f0ca8b269c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9d36f98d-00ba-405a-93e5-94f0ca8b269c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:16.783210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:16.784089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:16.784898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 100/213] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:16.790663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6ab0c-5830-4f98-9242-3e9671372415 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:16.837516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:16.902940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6ab0c-5830-4f98-9242-3e9671372415 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:16.939940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:16.940540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:16.940813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:16.941079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:16.941736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:16.942041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:16.943500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:16.945393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36f98d-00ba-405a-93e5-94f0ca8b269c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:16.953885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 114/214] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:16.960105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:17.065987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36f98d-00ba-405a-93e5-94f0ca8b269c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:17.069250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:17.095910 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df370690-4062-45ed-af16-cf47c15ee1cc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:17.098007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:17.109474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650dc33-cf09-46b1-b8f5-46c3935c1621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:17.110333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650dc33-cf09-46b1-b8f5-46c3935c1621 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.110608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650dc33-cf09-46b1-b8f5-46c3935c1621 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.110900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650dc33-cf09-46b1-b8f5-46c3935c1621 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.112003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650dc33-cf09-46b1-b8f5-46c3935c1621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:17.114186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650dc33-cf09-46b1-b8f5-46c3935c1621 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:17.116201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 101/215] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:17.121781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650dc33-cf09-46b1-b8f5-46c3935c1621 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:17.138704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6d61-2148-4a87-8d3e-448a08904646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:17.139868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6d61-2148-4a87-8d3e-448a08904646 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.140669 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6d61-2148-4a87-8d3e-448a08904646 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.141120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6d61-2148-4a87-8d3e-448a08904646 None admin] PATH_INFO: `/v3/users/07ff5f6aaf8b4335a984fb9860ed7a7a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.166954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b6d61-2148-4a87-8d3e-448a08904646 None admin] RBAC: Authorizing `identity:get_user(user_id=07ff5f6aaf8b4335a984fb9860ed7a7a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:17.168442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b6d61-2148-4a87-8d3e-448a08904646 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:17.174842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 115/216] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:16 2022] GET /identity/v3/users/07ff5f6aaf8b4335a984fb9860ed7a7a => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:17.176202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6d61-2148-4a87-8d3e-448a08904646 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:17.252443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650dc33-cf09-46b1-b8f5-46c3935c1621 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:17.298315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e75705-34e9-4254-bb51-032f41d6edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:17.299034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e75705-34e9-4254-bb51-032f41d6edaa None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.299550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e75705-34e9-4254-bb51-032f41d6edaa None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.299825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e75705-34e9-4254-bb51-032f41d6edaa None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.300489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e75705-34e9-4254-bb51-032f41d6edaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:17.302620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e75705-34e9-4254-bb51-032f41d6edaa None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:17.307135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6d61-2148-4a87-8d3e-448a08904646 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:17.332875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 102/217] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:17 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:47:17.356116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd036e-d531-4fed-bae1-9af73d4ebbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:17.356991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd036e-d531-4fed-bae1-9af73d4ebbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.357416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd036e-d531-4fed-bae1-9af73d4ebbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.357830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd036e-d531-4fed-bae1-9af73d4ebbf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.391957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:17.441574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd036e-d531-4fed-bae1-9af73d4ebbf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:17.443431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd036e-d531-4fed-bae1-9af73d4ebbf5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:17.554029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 116/218] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:17.560472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e75705-34e9-4254-bb51-032f41d6edaa None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:17.598604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:17.678778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e75705-34e9-4254-bb51-032f41d6edaa None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:17.702210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a409ec7-e06c-4301-aee7-373911dd4363 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.702210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a409ec7-e06c-4301-aee7-373911dd4363 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.702666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a409ec7-e06c-4301-aee7-373911dd4363 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.704468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 117/219] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:17.711214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da69a-860f-435d-b311-acb1fe0d137f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.711623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da69a-860f-435d-b311-acb1fe0d137f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.712433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da69a-860f-435d-b311-acb1fe0d137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.721048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110c920-d7de-43f7-969e-966a22abe63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:17.721809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c920-d7de-43f7-969e-966a22abe63b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.722087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c920-d7de-43f7-969e-966a22abe63b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.722357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c920-d7de-43f7-969e-966a22abe63b None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.723775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110c920-d7de-43f7-969e-966a22abe63b None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:17.725255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110c920-d7de-43f7-969e-966a22abe63b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:17.727424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 103/220] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:17 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:17.738377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110c920-d7de-43f7-969e-966a22abe63b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:17.741696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8c8da69a-860f-435d-b311-acb1fe0d137f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:17.746812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8c8da69a-860f-435d-b311-acb1fe0d137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:17.818669 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:17.835171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 118/221] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:17.862023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:17.866656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880b8a0-e320-4c44-a79d-4f293caa09c9 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.867018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880b8a0-e320-4c44-a79d-4f293caa09c9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.867295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880b8a0-e320-4c44-a79d-4f293caa09c9 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.869435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 119/222] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:17.874026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110c920-d7de-43f7-969e-966a22abe63b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:17.875388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223e6d-ce82-402c-8d60-8620a3a21e0d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.875890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223e6d-ce82-402c-8d60-8620a3a21e0d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.876354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223e6d-ce82-402c-8d60-8620a3a21e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.895713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ce223e6d-ce82-402c-8d60-8620a3a21e0d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:17.897204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ce223e6d-ce82-402c-8d60-8620a3a21e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:17.917144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:17.917144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:17.917406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:17.917733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:17.918473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] RBAC: Adding query filter params (role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=4e3eb031806d4c758fdf3846558516d7, user.id=07ff5f6aaf8b4335a984fb9860ed7a7a) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:17.918800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:17.922811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:17.935339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 104/223] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:17 2022] GET /identity/v3/role_assignments?user.id=07ff5f6aaf8b4335a984fb9860ed7a7a&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:17.986214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 120/224] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:18.148310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:18.267539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825becc-4441-4960-9b0c-84dbae6d9e61 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:18.317763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544493a-9a7e-46e7-826f-cd8cc0bfe386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:18.318416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544493a-9a7e-46e7-826f-cd8cc0bfe386 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:18.318698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544493a-9a7e-46e7-826f-cd8cc0bfe386 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:18.319004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544493a-9a7e-46e7-826f-cd8cc0bfe386 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:18.332860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544493a-9a7e-46e7-826f-cd8cc0bfe386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b544493a-9a7e-46e7-826f-cd8cc0bfe386 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:18.338845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:18.339706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:18.341071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 105/225] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:18.344256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223e6d-ce82-402c-8d60-8620a3a21e0d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:18.345947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544493a-9a7e-46e7-826f-cd8cc0bfe386 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:18.376257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:18.454284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544493a-9a7e-46e7-826f-cd8cc0bfe386 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:18.492294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:18.493488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:18.494246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:18.494771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:18.495671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:18.496172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:18.497825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:18.508542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 106/226] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:18.514300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:18.605747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:18.627386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78651-2cfc-4699-9b5a-d0702c23e524 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:18.636731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223e6d-ce82-402c-8d60-8620a3a21e0d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:18.677878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8bbf7-4d79-4e69-a068-18aef2631214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:18.678908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8bbf7-4d79-4e69-a068-18aef2631214 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:18.679406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8bbf7-4d79-4e69-a068-18aef2631214 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:18.679884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8bbf7-4d79-4e69-a068-18aef2631214 None admin] PATH_INFO: `/v3/users/b0d14631c8fb4b08979de1304cd40ba9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:18.681420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8bbf7-4d79-4e69-a068-18aef2631214 None admin] RBAC: Authorizing `identity:get_user(user_id=b0d14631c8fb4b08979de1304cd40ba9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:18.683167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8bbf7-4d79-4e69-a068-18aef2631214 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:18.685112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 107/227] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:18 2022] GET /identity/v3/users/b0d14631c8fb4b08979de1304cd40ba9 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:18.690070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:18.691848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8bbf7-4d79-4e69-a068-18aef2631214 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:18.729962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930f6ad-3a38-423a-9e51-911eda31b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:18.731645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f6ad-3a38-423a-9e51-911eda31b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:18.732721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f6ad-3a38-423a-9e51-911eda31b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:18.733721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f6ad-3a38-423a-9e51-911eda31b0b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:18.760122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930f6ad-3a38-423a-9e51-911eda31b0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-4930f6ad-3a38-423a-9e51-911eda31b0b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:18.769246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:18.770128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:18.770966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:18.774604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 121/228] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:18.783792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930f6ad-3a38-423a-9e51-911eda31b0b3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:18.839074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8bbf7-4d79-4e69-a068-18aef2631214 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:18.874845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6643470-7adb-4ad1-80ab-db2d3630698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:18.875418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6643470-7adb-4ad1-80ab-db2d3630698b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:18.875691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6643470-7adb-4ad1-80ab-db2d3630698b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:18.876210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6643470-7adb-4ad1-80ab-db2d3630698b None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:18.877065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6643470-7adb-4ad1-80ab-db2d3630698b None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:18.878480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6643470-7adb-4ad1-80ab-db2d3630698b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:18.880486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 108/229] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:18 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:18.887768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6643470-7adb-4ad1-80ab-db2d3630698b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:18.927485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:19.004416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930f6ad-3a38-423a-9e51-911eda31b0b3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:19.070564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:19.071252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:19.071690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:19.072132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:19.072802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:19.073101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:19.074464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:19.090702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6643470-7adb-4ad1-80ab-db2d3630698b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:19.095707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 122/230] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:19.101367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:19.132861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b5e1d-aaf6-40cb-a425-3536abc9c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:19.133723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5e1d-aaf6-40cb-a425-3536abc9c8e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:19.133850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5e1d-aaf6-40cb-a425-3536abc9c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:19.134228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b5e1d-aaf6-40cb-a425-3536abc9c8e1 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7/users/b0d14631c8fb4b08979de1304cd40ba9/roles/043adf092a6b422e961a0edc97df0a66` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:19.136612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b5e1d-aaf6-40cb-a425-3536abc9c8e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e3eb031806d4c758fdf3846558516d7, user_id=b0d14631c8fb4b08979de1304cd40ba9, role_id=043adf092a6b422e961a0edc97df0a66)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:19.138044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b5e1d-aaf6-40cb-a425-3536abc9c8e1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:19.161244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 109/231] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:18 2022] PUT /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7/users/b0d14631c8fb4b08979de1304cd40ba9/roles/043adf092a6b422e961a0edc97df0a66 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:19.200621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:19.267375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e8b95-ee7b-4e30-b1a7-f778bcc36fb2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:19.304740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a379-a7ad-495c-b91d-2279ea04f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:19.305383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a379-a7ad-495c-b91d-2279ea04f4fd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:19.305809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a379-a7ad-495c-b91d-2279ea04f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:19.306277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a379-a7ad-495c-b91d-2279ea04f4fd None admin] PATH_INFO: `/v3/users/b0d14631c8fb4b08979de1304cd40ba9` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:19.307657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858a379-a7ad-495c-b91d-2279ea04f4fd None admin] RBAC: Authorizing `identity:get_user(user_id=b0d14631c8fb4b08979de1304cd40ba9)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:19.309108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858a379-a7ad-495c-b91d-2279ea04f4fd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:19.314781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 123/232] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:19 2022] GET /identity/v3/users/b0d14631c8fb4b08979de1304cd40ba9 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:19.317712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b5e1d-aaf6-40cb-a425-3536abc9c8e1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:19.456008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:19.482273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b5e1d-aaf6-40cb-a425-3536abc9c8e1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:19.517916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d72b66-d210-4893-9d0f-02cd52f5b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:19.519451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72b66-d210-4893-9d0f-02cd52f5b66c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:19.519867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72b66-d210-4893-9d0f-02cd52f5b66c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:19.520295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72b66-d210-4893-9d0f-02cd52f5b66c None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:19.521577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d72b66-d210-4893-9d0f-02cd52f5b66c None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:19.523343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d72b66-d210-4893-9d0f-02cd52f5b66c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:19.526124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 110/233] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:19 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:19.532164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a379-a7ad-495c-b91d-2279ea04f4fd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:19.676618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a379-a7ad-495c-b91d-2279ea04f4fd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:19.695096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:19.726561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e34a8-32b1-4580-9294-1910110db584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:19.727165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e34a8-32b1-4580-9294-1910110db584 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:19.727500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e34a8-32b1-4580-9294-1910110db584 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:19.727883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e34a8-32b1-4580-9294-1910110db584 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7/users/b0d14631c8fb4b08979de1304cd40ba9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:19.730053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e34a8-32b1-4580-9294-1910110db584 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e3eb031806d4c758fdf3846558516d7, user_id=b0d14631c8fb4b08979de1304cd40ba9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:19.731576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e34a8-32b1-4580-9294-1910110db584 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:19.757658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 124/234] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:19 2022] PUT /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7/users/b0d14631c8fb4b08979de1304cd40ba9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:20.105616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c3bbb-c1ff-4d78-a609-f9a55bdb6177 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:20.106013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c3bbb-c1ff-4d78-a609-f9a55bdb6177 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:20.106195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c3bbb-c1ff-4d78-a609-f9a55bdb6177 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:20.107701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 111/235] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:20.112992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009772-37cf-4ee1-9842-676fee0c13a7 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:20.113284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009772-37cf-4ee1-9842-676fee0c13a7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:20.113564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009772-37cf-4ee1-9842-676fee0c13a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:20.132240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-88009772-37cf-4ee1-9842-676fee0c13a7 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:20.133436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-88009772-37cf-4ee1-9842-676fee0c13a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:20.208020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 125/236] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:20.328807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f705cf-0a13-4d71-af46-a00b6ad407c1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:20.329351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f705cf-0a13-4d71-af46-a00b6ad407c1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:20.329429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f705cf-0a13-4d71-af46-a00b6ad407c1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:20.331038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 112/237] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:20.336277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6399-612e-4253-a97f-facf96ae1f21 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:20.336559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6399-612e-4253-a97f-facf96ae1f21 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:20.336884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6399-612e-4253-a97f-facf96ae1f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:20.360092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ffdb6399-612e-4253-a97f-facf96ae1f21 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:20.361235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ffdb6399-612e-4253-a97f-facf96ae1f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:20.464507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 126/238] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:20.574119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f705cf-0a13-4d71-af46-a00b6ad407c1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:20.633686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fd2f8-251e-4db9-a209-a482bc96da4e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:20.634251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fd2f8-251e-4db9-a209-a482bc96da4e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:20.634251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fd2f8-251e-4db9-a209-a482bc96da4e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:20.635713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 127/239] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:20.640717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce181b-12f4-4282-9c28-487986aaa3b0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:20.640998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce181b-12f4-4282-9c28-487986aaa3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:20.641277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce181b-12f4-4282-9c28-487986aaa3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:20.662772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7dce181b-12f4-4282-9c28-487986aaa3b0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:20.662772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7dce181b-12f4-4282-9c28-487986aaa3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:20.704168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:20.743285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f705cf-0a13-4d71-af46-a00b6ad407c1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:20.781633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 128/240] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:20.791100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e993ae-ffeb-44f4-b029-0cd663d0b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:20.791735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e993ae-ffeb-44f4-b029-0cd663d0b0ee None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:20.792013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e993ae-ffeb-44f4-b029-0cd663d0b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:20.792283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e993ae-ffeb-44f4-b029-0cd663d0b0ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:20.808204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e993ae-ffeb-44f4-b029-0cd663d0b0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-06e993ae-ffeb-44f4-b029-0cd663d0b0ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:20.813074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:20.813950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:20.814723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:20.815350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce181b-12f4-4282-9c28-487986aaa3b0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:20.815429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 113/241] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:20.819857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e993ae-ffeb-44f4-b029-0cd663d0b0ee None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:20.843127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:20.979918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e993ae-ffeb-44f4-b029-0cd663d0b0ee None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:20.996942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce181b-12f4-4282-9c28-487986aaa3b0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:21.047722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.048331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.048600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.048862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.049521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:21.049815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:21.051204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:21.062561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 114/242] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:21.068153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:21.079718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34cd6e-d496-4794-b9b1-ab70f2996637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.080400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34cd6e-d496-4794-b9b1-ab70f2996637 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.080674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34cd6e-d496-4794-b9b1-ab70f2996637 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.080938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34cd6e-d496-4794-b9b1-ab70f2996637 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.082116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34cd6e-d496-4794-b9b1-ab70f2996637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:21.083566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34cd6e-d496-4794-b9b1-ab70f2996637 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:21.085109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 129/243] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:21.092735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34cd6e-d496-4794-b9b1-ab70f2996637 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:21.132736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:21.179142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:21.208130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34cd6e-d496-4794-b9b1-ab70f2996637 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:21.222244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49e72-7636-4f04-9b18-904b47873ece None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:21.245816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197ec4-0dbe-47d7-a43d-b04ec8dda792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.246533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197ec4-0dbe-47d7-a43d-b04ec8dda792 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.246934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197ec4-0dbe-47d7-a43d-b04ec8dda792 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.247299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197ec4-0dbe-47d7-a43d-b04ec8dda792 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.248310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe197ec4-0dbe-47d7-a43d-b04ec8dda792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:21.249844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe197ec4-0dbe-47d7-a43d-b04ec8dda792 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:21.265427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca627bf-92b1-451a-a3d8-8ef06c6fa35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.266053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca627bf-92b1-451a-a3d8-8ef06c6fa35c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.266328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca627bf-92b1-451a-a3d8-8ef06c6fa35c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.266593 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca627bf-92b1-451a-a3d8-8ef06c6fa35c None admin] PATH_INFO: `/v3/users/ad9c28eec5264f85b18110b13f71f083` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.275925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 130/244] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:21 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:47:21.277097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197ec4-0dbe-47d7-a43d-b04ec8dda792 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:21.291568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca627bf-92b1-451a-a3d8-8ef06c6fa35c None admin] RBAC: Authorizing `identity:get_user(user_id=ad9c28eec5264f85b18110b13f71f083)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:21.293140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca627bf-92b1-451a-a3d8-8ef06c6fa35c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:21.298854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 115/245] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:21 2022] GET /identity/v3/users/ad9c28eec5264f85b18110b13f71f083 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:21.301446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca627bf-92b1-451a-a3d8-8ef06c6fa35c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:21.424768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:21.460469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197ec4-0dbe-47d7-a43d-b04ec8dda792 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:21.526397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca627bf-92b1-451a-a3d8-8ef06c6fa35c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:21.534161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f417e0-793b-49eb-bddd-94aac7b65693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.537310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f417e0-793b-49eb-bddd-94aac7b65693 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.537310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f417e0-793b-49eb-bddd-94aac7b65693 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.537310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f417e0-793b-49eb-bddd-94aac7b65693 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.554885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f417e0-793b-49eb-bddd-94aac7b65693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-54f417e0-793b-49eb-bddd-94aac7b65693 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:21.563955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:21.564998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:21.565782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:21.568922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 131/246] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:21.573025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:21.576840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f417e0-793b-49eb-bddd-94aac7b65693 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:21.585944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772a96f-bbd7-4271-bb25-cd01de35cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.586551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772a96f-bbd7-4271-bb25-cd01de35cda9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.586986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772a96f-bbd7-4271-bb25-cd01de35cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.587478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772a96f-bbd7-4271-bb25-cd01de35cda9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.668611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772a96f-bbd7-4271-bb25-cd01de35cda9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:21.670060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772a96f-bbd7-4271-bb25-cd01de35cda9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:21.698254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f417e0-793b-49eb-bddd-94aac7b65693 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:21.736441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.737467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.737942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.738408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.739318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:21.739817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:21.741547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:21.751100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 132/247] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:21.756922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:21.768399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:21.782284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 116/248] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:21.787167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772a96f-bbd7-4271-bb25-cd01de35cda9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:21.821746 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:21.878635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7c831-2192-40cf-bac5-0c64d31f4791 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:21.904948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772a96f-bbd7-4271-bb25-cd01de35cda9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:21.918684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9adc27-20d7-4c2e-b1a2-6eb47ed16e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.919714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9adc27-20d7-4c2e-b1a2-6eb47ed16e1b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.920187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9adc27-20d7-4c2e-b1a2-6eb47ed16e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.920768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9adc27-20d7-4c2e-b1a2-6eb47ed16e1b None admin] PATH_INFO: `/v3/users/07ff5f6aaf8b4335a984fb9860ed7a7a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.922223 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9adc27-20d7-4c2e-b1a2-6eb47ed16e1b None admin] RBAC: Authorizing `identity:get_user(user_id=07ff5f6aaf8b4335a984fb9860ed7a7a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:21.924144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9adc27-20d7-4c2e-b1a2-6eb47ed16e1b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:21.926409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 133/249] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:21 2022] GET /identity/v3/users/07ff5f6aaf8b4335a984fb9860ed7a7a => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:21.932640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9adc27-20d7-4c2e-b1a2-6eb47ed16e1b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:21.942588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868077-3c29-4e50-b00b-e9dd4e53430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:21.943260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868077-3c29-4e50-b00b-e9dd4e53430f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:21.943536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868077-3c29-4e50-b00b-e9dd4e53430f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:21.943808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868077-3c29-4e50-b00b-e9dd4e53430f None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:21.944941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86868077-3c29-4e50-b00b-e9dd4e53430f None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:21.946588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86868077-3c29-4e50-b00b-e9dd4e53430f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:21.948691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 117/250] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:21 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:21.954531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868077-3c29-4e50-b00b-e9dd4e53430f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:22.036205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:22.068413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9adc27-20d7-4c2e-b1a2-6eb47ed16e1b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:22.083113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:22.089534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868077-3c29-4e50-b00b-e9dd4e53430f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:22.120824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab341c-c291-4c80-bafd-3114756f54a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:22.121765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab341c-c291-4c80-bafd-3114756f54a9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:22.122047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab341c-c291-4c80-bafd-3114756f54a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:22.122320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab341c-c291-4c80-bafd-3114756f54a9 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:22.123998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab341c-c291-4c80-bafd-3114756f54a9 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:22.127243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab341c-c291-4c80-bafd-3114756f54a9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:22.129439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 134/251] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:21 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:22.130817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781122db-f075-44d7-b577-07e4b020f3af None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:22.132024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781122db-f075-44d7-b577-07e4b020f3af None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:22.133034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781122db-f075-44d7-b577-07e4b020f3af None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:22.134622 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 135/252] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:22.140333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bcdbf-5417-45ac-8d4c-b54c6b24480e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:22.140615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bcdbf-5417-45ac-8d4c-b54c6b24480e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:22.140886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bcdbf-5417-45ac-8d4c-b54c6b24480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:22.143211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:22.144172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:22.144665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:22.145129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:22.146052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] RBAC: Adding query filter params (role.id=68ce6057586947a4abce25fb4a5752ab, scope.project.id=4e3eb031806d4c758fdf3846558516d7, user.id=ad9c28eec5264f85b18110b13f71f083) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:22.146571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:22.148426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:22.156249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 118/253] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:21 2022] GET /identity/v3/role_assignments?user.id=ad9c28eec5264f85b18110b13f71f083&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=68ce6057586947a4abce25fb4a5752ab => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:22.157459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:22.175852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a59bcdbf-5417-45ac-8d4c-b54c6b24480e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:22.177087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a59bcdbf-5417-45ac-8d4c-b54c6b24480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:22.305138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4167b9-90f7-4f16-93d0-2c2f3b3fca65 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:22.337858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 136/254] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:22.372455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756427b-e7d4-4e44-9e02-77710567b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:22.373765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756427b-e7d4-4e44-9e02-77710567b323 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:22.374236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756427b-e7d4-4e44-9e02-77710567b323 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:22.374700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756427b-e7d4-4e44-9e02-77710567b323 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7/users/07ff5f6aaf8b4335a984fb9860ed7a7a/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:22.379748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756427b-e7d4-4e44-9e02-77710567b323 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e3eb031806d4c758fdf3846558516d7, user_id=07ff5f6aaf8b4335a984fb9860ed7a7a, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:22.381209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756427b-e7d4-4e44-9e02-77710567b323 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:22.405239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 119/255] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:22 2022] PUT /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7/users/07ff5f6aaf8b4335a984fb9860ed7a7a/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:22.641729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bcdbf-5417-45ac-8d4c-b54c6b24480e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:22.702845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a14fa-48be-403b-a88c-0944ee079882 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:22.703372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a14fa-48be-403b-a88c-0944ee079882 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:22.703372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a14fa-48be-403b-a88c-0944ee079882 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:22.704732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 120/256] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:22.733771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974e059-7fcc-40f0-8ada-b9ea64630583 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:22.734101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974e059-7fcc-40f0-8ada-b9ea64630583 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:22.734309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974e059-7fcc-40f0-8ada-b9ea64630583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:22.754109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:22.771924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c974e059-7fcc-40f0-8ada-b9ea64630583 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:22.773244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c974e059-7fcc-40f0-8ada-b9ea64630583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:22.789540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bcdbf-5417-45ac-8d4c-b54c6b24480e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:22.798277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:22.832757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ce521-feba-4580-a75d-3c06e0871eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:22.833402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ce521-feba-4580-a75d-3c06e0871eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:22.833675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ce521-feba-4580-a75d-3c06e0871eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:22.833940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ce521-feba-4580-a75d-3c06e0871eb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:22.846569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ce521-feba-4580-a75d-3c06e0871eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a51ce521-feba-4580-a75d-3c06e0871eb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:22.853252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:22.854149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:22.855393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 137/257] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:22.860380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ce521-feba-4580-a75d-3c06e0871eb5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:22.932496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 121/258] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:22.993820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ce521-feba-4580-a75d-3c06e0871eb5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:23.030698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:23.039816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:23.040439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:23.041108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:23.041376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:23.042048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:23.042348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:23.043817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:23.056704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 138/259] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:23.062548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974e059-7fcc-40f0-8ada-b9ea64630583 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:23.168138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974e059-7fcc-40f0-8ada-b9ea64630583 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:23.204089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db02657-e6f3-44c6-875e-1b52fa0750af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:23.204704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db02657-e6f3-44c6-875e-1b52fa0750af None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:23.204983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db02657-e6f3-44c6-875e-1b52fa0750af None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:23.205251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db02657-e6f3-44c6-875e-1b52fa0750af None admin] PATH_INFO: `/v3/users/b0d14631c8fb4b08979de1304cd40ba9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:23.206380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db02657-e6f3-44c6-875e-1b52fa0750af None admin] RBAC: Authorizing `identity:get_user(user_id=b0d14631c8fb4b08979de1304cd40ba9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:23.207844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db02657-e6f3-44c6-875e-1b52fa0750af None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:23.209634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 122/260] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:23 2022] GET /identity/v3/users/b0d14631c8fb4b08979de1304cd40ba9 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:23.215237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:23.322612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6382f89-262e-4d70-b74a-682f27e34373 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:23.358361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315623b-1ed8-42ee-9066-acdaf42c9068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:23.359005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315623b-1ed8-42ee-9066-acdaf42c9068 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:23.359280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315623b-1ed8-42ee-9066-acdaf42c9068 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:23.359547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315623b-1ed8-42ee-9066-acdaf42c9068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:23.426004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:23.436795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315623b-1ed8-42ee-9066-acdaf42c9068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:23.438343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315623b-1ed8-42ee-9066-acdaf42c9068 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:23.543818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db02657-e6f3-44c6-875e-1b52fa0750af None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:23.573052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 139/261] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:23.578824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315623b-1ed8-42ee-9066-acdaf42c9068 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:23.596632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:23.755168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:23.773965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db02657-e6f3-44c6-875e-1b52fa0750af None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:23.775052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315623b-1ed8-42ee-9066-acdaf42c9068 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:23.835539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79fa2d-fdcf-46b1-a3e1-a9a60396c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:23.836090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79fa2d-fdcf-46b1-a3e1-a9a60396c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:23.836365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79fa2d-fdcf-46b1-a3e1-a9a60396c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:23.837260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79fa2d-fdcf-46b1-a3e1-a9a60396c0e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:23.859728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79fa2d-fdcf-46b1-a3e1-a9a60396c0e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:23.863444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511afd4-f04f-4779-afaf-2c18d06a6f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:23.864091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511afd4-f04f-4779-afaf-2c18d06a6f95 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:23.864373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511afd4-f04f-4779-afaf-2c18d06a6f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fc79fa2d-fdcf-46b1-a3e1-a9a60396c0e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:23.864559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:23.865416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:23.866208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:23.866841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511afd4-f04f-4779-afaf-2c18d06a6f95 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:23.866841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511afd4-f04f-4779-afaf-2c18d06a6f95 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:23.867422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511afd4-f04f-4779-afaf-2c18d06a6f95 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:23.869229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 140/262] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:23 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:23.874071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 123/263] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:23.875661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511afd4-f04f-4779-afaf-2c18d06a6f95 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:23.875770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79fa2d-fdcf-46b1-a3e1-a9a60396c0e5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:24.003937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:24.045520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79fa2d-fdcf-46b1-a3e1-a9a60396c0e5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:24.092125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511afd4-f04f-4779-afaf-2c18d06a6f95 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:24.108312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:24.108935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:24.109217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:24.109495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:24.110500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:24.110838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:24.112222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:24.130438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 124/264] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:24.136517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:24.166591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:24.167468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:24.167761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:24.168032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:24.168768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] RBAC: Adding query filter params (role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=4e3eb031806d4c758fdf3846558516d7, user.id=b0d14631c8fb4b08979de1304cd40ba9) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:24.169133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:24.170687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:24.189339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 141/265] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:23 2022] GET /identity/v3/role_assignments?user.id=b0d14631c8fb4b08979de1304cd40ba9&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=043adf092a6b422e961a0edc97df0a66 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:24.307954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc5aa-97c8-4ca4-9475-d1993565f198 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:24.360415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b3679-56b1-4250-b938-94d28cdc0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:24.361415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b3679-56b1-4250-b938-94d28cdc0d80 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:24.361882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b3679-56b1-4250-b938-94d28cdc0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:24.362338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b3679-56b1-4250-b938-94d28cdc0d80 None admin] PATH_INFO: `/v3/users/b0d14631c8fb4b08979de1304cd40ba9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:24.363714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b3679-56b1-4250-b938-94d28cdc0d80 None admin] RBAC: Authorizing `identity:get_user(user_id=b0d14631c8fb4b08979de1304cd40ba9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:24.365332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b3679-56b1-4250-b938-94d28cdc0d80 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:24.367172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 125/266] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:24 2022] GET /identity/v3/users/b0d14631c8fb4b08979de1304cd40ba9 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:24.373933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:24.417123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:24.520341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267756f5-2c77-4e0a-9920-cb04eca60b21 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:24.569691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352f8d-dff9-4e1f-9916-5ef371826966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:24.570305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352f8d-dff9-4e1f-9916-5ef371826966 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:24.570583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352f8d-dff9-4e1f-9916-5ef371826966 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:24.571411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352f8d-dff9-4e1f-9916-5ef371826966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:24.658490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8352f8d-dff9-4e1f-9916-5ef371826966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:24.660337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8352f8d-dff9-4e1f-9916-5ef371826966 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:24.704573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:24.796399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 142/267] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:24.802008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b3679-56b1-4250-b938-94d28cdc0d80 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:24.817567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:24.949337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b3679-56b1-4250-b938-94d28cdc0d80 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:24.997205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b52a5-b4a7-4df9-9b22-daa016d3e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:24.998082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b52a5-b4a7-4df9-9b22-daa016d3e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:24.998368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b52a5-b4a7-4df9-9b22-daa016d3e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:24.998639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b52a5-b4a7-4df9-9b22-daa016d3e0f5 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.000171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b52a5-b4a7-4df9-9b22-daa016d3e0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:25.002557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b52a5-b4a7-4df9-9b22-daa016d3e0f5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:25.005504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 126/268] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:24 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:25.010719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352f8d-dff9-4e1f-9916-5ef371826966 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:25.143885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352f8d-dff9-4e1f-9916-5ef371826966 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:25.199159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:25.204164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58d24f-3fcd-4e52-9678-9b2bc26ec187 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.204420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58d24f-3fcd-4e52-9678-9b2bc26ec187 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.204648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58d24f-3fcd-4e52-9678-9b2bc26ec187 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.206132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 127/269] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:25.208290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5a961-a167-4fd7-bbb4-c11eaddbb6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:25.209327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a961-a167-4fd7-bbb4-c11eaddbb6de None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.209878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a961-a167-4fd7-bbb4-c11eaddbb6de None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.210555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a961-a167-4fd7-bbb4-c11eaddbb6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.211332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a961-a167-4fd7-bbb4-c11eaddbb6de None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=4e3eb031806d4c758fdf3846558516d7, user.id=b0d14631c8fb4b08979de1304cd40ba9) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:25.212187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a961-a167-4fd7-bbb4-c11eaddbb6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:25.214023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a961-a167-4fd7-bbb4-c11eaddbb6de None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:25.215108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668ee6f-2bee-4b55-9352-02516124ec92 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.215598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668ee6f-2bee-4b55-9352-02516124ec92 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.216057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668ee6f-2bee-4b55-9352-02516124ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.224760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 143/270] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:25 2022] GET /identity/v3/role_assignments?user.id=b0d14631c8fb4b08979de1304cd40ba9&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:25.237392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3668ee6f-2bee-4b55-9352-02516124ec92 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:25.239015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3668ee6f-2bee-4b55-9352-02516124ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:25.250784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a56c-553b-433e-8098-f3f15ba60c8e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.250784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a56c-553b-433e-8098-f3f15ba60c8e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.250784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a56c-553b-433e-8098-f3f15ba60c8e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.250784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 144/271] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:25.257740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337fec9-a7ce-4bb6-8850-8eef73c071ee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.258076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337fec9-a7ce-4bb6-8850-8eef73c071ee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.258283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337fec9-a7ce-4bb6-8850-8eef73c071ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.296985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7337fec9-a7ce-4bb6-8850-8eef73c071ee None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:25.298294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7337fec9-a7ce-4bb6-8850-8eef73c071ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:25.366780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 128/272] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:25.366780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17ed57-a864-4605-9c35-3eaaf778a626 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.366780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17ed57-a864-4605-9c35-3eaaf778a626 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.366780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17ed57-a864-4605-9c35-3eaaf778a626 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.366780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 129/273] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:25.368407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c84a-482a-447e-9306-a7178e312d4c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.368705 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c84a-482a-447e-9306-a7178e312d4c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.368976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c84a-482a-447e-9306-a7178e312d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.377747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:25.390360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3ff6c84a-482a-447e-9306-a7178e312d4c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:25.391622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3ff6c84a-482a-447e-9306-a7178e312d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:25.433027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 145/274] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:25.489454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 130/275] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:25.560172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4f30-7994-4945-b37e-a6ea7dce1551 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.560487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4f30-7994-4945-b37e-a6ea7dce1551 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.560704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4f30-7994-4945-b37e-a6ea7dce1551 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.562157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 146/276] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:25.567801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b72a8-3276-4dd2-90ba-17b0a48d56e8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.568086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b72a8-3276-4dd2-90ba-17b0a48d56e8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.568362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b72a8-3276-4dd2-90ba-17b0a48d56e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.591775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-535b72a8-3276-4dd2-90ba-17b0a48d56e8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:25.592960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-535b72a8-3276-4dd2-90ba-17b0a48d56e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:25.669316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 131/277] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:25.735846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd4f30-7994-4945-b37e-a6ea7dce1551 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:25.759491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b72a8-3276-4dd2-90ba-17b0a48d56e8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:25.823846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:25.846891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd4f30-7994-4945-b37e-a6ea7dce1551 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:25.865063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b72a8-3276-4dd2-90ba-17b0a48d56e8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:25.868954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:25.885161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915236ae-cfd5-4801-839b-a88e69cf7820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:25.885786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915236ae-cfd5-4801-839b-a88e69cf7820 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.886061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915236ae-cfd5-4801-839b-a88e69cf7820 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.886328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915236ae-cfd5-4801-839b-a88e69cf7820 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.896737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915236ae-cfd5-4801-839b-a88e69cf7820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-915236ae-cfd5-4801-839b-a88e69cf7820 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:25.902075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:25.903091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 147/278] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:25.908984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915236ae-cfd5-4801-839b-a88e69cf7820 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:25.909695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5979a9f-3b25-4fc5-a463-8335d743184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:25.909695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5979a9f-3b25-4fc5-a463-8335d743184b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:25.909695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5979a9f-3b25-4fc5-a463-8335d743184b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:25.909695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5979a9f-3b25-4fc5-a463-8335d743184b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:25.922902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5979a9f-3b25-4fc5-a463-8335d743184b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c5979a9f-3b25-4fc5-a463-8335d743184b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:25.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:25.928671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:25.929467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 132/279] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:25.934858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5979a9f-3b25-4fc5-a463-8335d743184b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.008828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915236ae-cfd5-4801-839b-a88e69cf7820 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.037928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5979a9f-3b25-4fc5-a463-8335d743184b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.042239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b9bfb-a06e-4aed-931c-d5ff40dd405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.042889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b9bfb-a06e-4aed-931c-d5ff40dd405c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.043162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b9bfb-a06e-4aed-931c-d5ff40dd405c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.043427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b9bfb-a06e-4aed-931c-d5ff40dd405c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.044557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b9bfb-a06e-4aed-931c-d5ff40dd405c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.045996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b9bfb-a06e-4aed-931c-d5ff40dd405c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.047579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 148/280] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.052781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b9bfb-a06e-4aed-931c-d5ff40dd405c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.061726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:26.073634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.074240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.074524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.074820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.075479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:26.075781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.077134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.085091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 133/281] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.085862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.108392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:26.158763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b9bfb-a06e-4aed-931c-d5ff40dd405c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.184309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a387-126c-42a1-9fa9-6a55d1b3a4b8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.191722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.192313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.192577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.192842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.193491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:26.193785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.195170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.203071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 149/282] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.203836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.217724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de96bfa-d897-4488-90ba-3f472d31e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.218546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de96bfa-d897-4488-90ba-3f472d31e938 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.218858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de96bfa-d897-4488-90ba-3f472d31e938 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.219138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de96bfa-d897-4488-90ba-3f472d31e938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.229568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de96bfa-d897-4488-90ba-3f472d31e938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0de96bfa-d897-4488-90ba-3f472d31e938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:26.234840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:26.235723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:26.236503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 134/283] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:26.237155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de96bfa-d897-4488-90ba-3f472d31e938 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.283846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:26.306185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b6263-1cfc-4b01-8e80-fccc3de5f3da None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.316239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:26.337670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de96bfa-d897-4488-90ba-3f472d31e938 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.339463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88537-a961-460b-b8a2-1764c626bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.340063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88537-a961-460b-b8a2-1764c626bd62 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.340334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88537-a961-460b-b8a2-1764c626bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.340598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88537-a961-460b-b8a2-1764c626bd62 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.341239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab88537-a961-460b-b8a2-1764c626bd62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.342656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab88537-a961-460b-b8a2-1764c626bd62 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.363978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 150/284] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:26 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:47:26.364781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88537-a961-460b-b8a2-1764c626bd62 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.373104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b553f-f1d9-45b9-afe1-eace0de9590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.373767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b553f-f1d9-45b9-afe1-eace0de9590c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.374047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b553f-f1d9-45b9-afe1-eace0de9590c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.374326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b553f-f1d9-45b9-afe1-eace0de9590c None admin] PATH_INFO: `/v3/users/ad9c28eec5264f85b18110b13f71f083` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.376426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b553f-f1d9-45b9-afe1-eace0de9590c None admin] RBAC: Authorizing `identity:get_user(user_id=ad9c28eec5264f85b18110b13f71f083)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.378334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b553f-f1d9-45b9-afe1-eace0de9590c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.380493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 135/285] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/users/ad9c28eec5264f85b18110b13f71f083 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.381388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b553f-f1d9-45b9-afe1-eace0de9590c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.496604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88537-a961-460b-b8a2-1764c626bd62 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.500921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b553f-f1d9-45b9-afe1-eace0de9590c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.515694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:26.535524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba988df7-e2cc-444f-b4e9-6abc5d444a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.536161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988df7-e2cc-444f-b4e9-6abc5d444a77 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.536434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988df7-e2cc-444f-b4e9-6abc5d444a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.536698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988df7-e2cc-444f-b4e9-6abc5d444a77 None admin] PATH_INFO: `/v3/users/2b40bab7a3234f2e8331e004a0221e30` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.541253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.541865 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.542148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.542421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.543122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:26.543430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.544797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.553668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 136/286] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.554486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.554785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba988df7-e2cc-444f-b4e9-6abc5d444a77 None admin] RBAC: Authorizing `identity:get_user(user_id=2b40bab7a3234f2e8331e004a0221e30)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.557231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba988df7-e2cc-444f-b4e9-6abc5d444a77 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.559128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 151/287] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/users/2b40bab7a3234f2e8331e004a0221e30 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.565661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba988df7-e2cc-444f-b4e9-6abc5d444a77 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.594876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:26.685032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b1fd7-a983-4968-a72e-713b464adb9b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.697559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba988df7-e2cc-444f-b4e9-6abc5d444a77 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.726699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd51d-c267-40a1-930d-41cd8d623e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.727844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd51d-c267-40a1-930d-41cd8d623e39 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.728363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd51d-c267-40a1-930d-41cd8d623e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.728803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd51d-c267-40a1-930d-41cd8d623e39 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.730290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dd51d-c267-40a1-930d-41cd8d623e39 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.732117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dd51d-c267-40a1-930d-41cd8d623e39 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.734268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 137/288] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.735851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd51d-c267-40a1-930d-41cd8d623e39 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.737212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3bc0-ae6b-4885-aed3-9f39a30a8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.737857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3bc0-ae6b-4885-aed3-9f39a30a8c27 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.738133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3bc0-ae6b-4885-aed3-9f39a30a8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.738596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e3bc0-ae6b-4885-aed3-9f39a30a8c27 None admin] PATH_INFO: `/v3/users/07ff5f6aaf8b4335a984fb9860ed7a7a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.740920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e3bc0-ae6b-4885-aed3-9f39a30a8c27 None admin] RBAC: Authorizing `identity:get_user(user_id=07ff5f6aaf8b4335a984fb9860ed7a7a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.742381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e3bc0-ae6b-4885-aed3-9f39a30a8c27 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.744322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 152/289] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/users/07ff5f6aaf8b4335a984fb9860ed7a7a => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.745091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3bc0-ae6b-4885-aed3-9f39a30a8c27 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.793309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:26.860668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:26.869620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd51d-c267-40a1-930d-41cd8d623e39 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.871272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e3bc0-ae6b-4885-aed3-9f39a30a8c27 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:26.908629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679f0d-06df-4e89-a38f-945d15d648c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.909840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679f0d-06df-4e89-a38f-945d15d648c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.910347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679f0d-06df-4e89-a38f-945d15d648c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.910914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679f0d-06df-4e89-a38f-945d15d648c5 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7/users/ad9c28eec5264f85b18110b13f71f083/roles/68ce6057586947a4abce25fb4a5752ab` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.912943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1679f0d-06df-4e89-a38f-945d15d648c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e3eb031806d4c758fdf3846558516d7, user_id=ad9c28eec5264f85b18110b13f71f083, role_id=68ce6057586947a4abce25fb4a5752ab)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.914470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1679f0d-06df-4e89-a38f-945d15d648c5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.915439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:26.916300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:26.916727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:26.917137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:26.918288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] RBAC: Adding query filter params (role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, user.id=2b40bab7a3234f2e8331e004a0221e30, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:26.919248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:26.921046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:26.927491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 138/290] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/role_assignments?user.id=2b40bab7a3234f2e8331e004a0221e30&scope.system=all&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:26.934815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:26.941802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 153/291] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:47:26 2022] PUT /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7/users/ad9c28eec5264f85b18110b13f71f083/roles/68ce6057586947a4abce25fb4a5752ab => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:27.137423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c327e-300f-4ffa-8dd4-2889debddd80 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:27.160007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:27.187724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e50b3-43c6-4952-940d-bc34c5e0ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:27.188327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e50b3-43c6-4952-940d-bc34c5e0ff86 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:27.188606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e50b3-43c6-4952-940d-bc34c5e0ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:27.188876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e50b3-43c6-4952-940d-bc34c5e0ff86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:27.259795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e50b3-43c6-4952-940d-bc34c5e0ff86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:27.261316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e50b3-43c6-4952-940d-bc34c5e0ff86 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:27.364433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 139/292] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:27.375956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679f0d-06df-4e89-a38f-945d15d648c5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:27.509336 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679f0d-06df-4e89-a38f-945d15d648c5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:27.545924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55673257-bc9b-475f-894e-4b099a114fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:27.546847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55673257-bc9b-475f-894e-4b099a114fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:27.547273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55673257-bc9b-475f-894e-4b099a114fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:27.547689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55673257-bc9b-475f-894e-4b099a114fa5 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:27.548968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55673257-bc9b-475f-894e-4b099a114fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:27.550562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55673257-bc9b-475f-894e-4b099a114fa5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:27.552441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 154/293] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:27 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:27.563033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e50b3-43c6-4952-940d-bc34c5e0ff86 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:27.574360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:27.691129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e50b3-43c6-4952-940d-bc34c5e0ff86 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:27.768961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0e597-3fbc-4681-aa83-101aa1070238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:27.769488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e597-3fbc-4681-aa83-101aa1070238 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:27.769763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e597-3fbc-4681-aa83-101aa1070238 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:27.770032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e597-3fbc-4681-aa83-101aa1070238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:27.770775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0e597-3fbc-4681-aa83-101aa1070238 None admin] RBAC: Adding query filter params (role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=4e3eb031806d4c758fdf3846558516d7, user.id=07ff5f6aaf8b4335a984fb9860ed7a7a) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:27.771087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0e597-3fbc-4681-aa83-101aa1070238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:27.772522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0e597-3fbc-4681-aa83-101aa1070238 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:27.783253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 140/294] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:27 2022] GET /identity/v3/role_assignments?user.id=07ff5f6aaf8b4335a984fb9860ed7a7a&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:28.864291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ae9b-3b0c-4e1d-97a2-06c63a27a382 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:28.864849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ae9b-3b0c-4e1d-97a2-06c63a27a382 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:28.864849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ae9b-3b0c-4e1d-97a2-06c63a27a382 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:28.866428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 155/295] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:28.873711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f8199-1280-4391-bd31-95c3320dec2e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:28.874680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f8199-1280-4391-bd31-95c3320dec2e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:28.875217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f8199-1280-4391-bd31-95c3320dec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:28.895061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2c6f8199-1280-4391-bd31-95c3320dec2e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:28.896590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2c6f8199-1280-4391-bd31-95c3320dec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:28.971374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 141/296] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:28.994986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc083e-16e7-433b-a52b-6bd5da99f607 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:28.995308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc083e-16e7-433b-a52b-6bd5da99f607 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:28.995537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc083e-16e7-433b-a52b-6bd5da99f607 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:28.996901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 156/297] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:29.002446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2c938-08df-4952-97d4-df5802d6b342 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.002913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2c938-08df-4952-97d4-df5802d6b342 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.003345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2c938-08df-4952-97d4-df5802d6b342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.010811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:29.023986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e3c2c938-08df-4952-97d4-df5802d6b342 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:29.025369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e3c2c938-08df-4952-97d4-df5802d6b342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:29.095747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 142/298] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:29.249062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc083e-16e7-433b-a52b-6bd5da99f607 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:29.272041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:29.358139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc083e-16e7-433b-a52b-6bd5da99f607 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:29.380831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2c938-08df-4952-97d4-df5802d6b342 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:29.401901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162799ba-37d5-4647-a341-27827c7c1cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:29.403040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162799ba-37d5-4647-a341-27827c7c1cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.403564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162799ba-37d5-4647-a341-27827c7c1cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.404030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162799ba-37d5-4647-a341-27827c7c1cb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.418527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162799ba-37d5-4647-a341-27827c7c1cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-162799ba-37d5-4647-a341-27827c7c1cb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:29.424308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:29.425270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:29.426036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:29.433850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 157/299] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:29.435182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162799ba-37d5-4647-a341-27827c7c1cb6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:29.512369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2c938-08df-4952-97d4-df5802d6b342 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:29.533926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:29.554114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162799ba-37d5-4647-a341-27827c7c1cb6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:29.554280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:29.560342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12210d-787c-4f1a-803e-9374ab5ab2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:29.560983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12210d-787c-4f1a-803e-9374ab5ab2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.561260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12210d-787c-4f1a-803e-9374ab5ab2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.561530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12210d-787c-4f1a-803e-9374ab5ab2e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.562638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12210d-787c-4f1a-803e-9374ab5ab2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:29.564121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12210d-787c-4f1a-803e-9374ab5ab2e5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:29.565688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 143/300] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:29.566984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0345-e344-41e6-afd2-da68adc3e184 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.567432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0345-e344-41e6-afd2-da68adc3e184 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.567534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0345-e344-41e6-afd2-da68adc3e184 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.568831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 144/301] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:29.570990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a0345-e344-41e6-afd2-da68adc3e184 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:29.595620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55437d5d-f941-4103-bf35-c317262c3f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:29.596228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437d5d-f941-4103-bf35-c317262c3f3d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.596507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437d5d-f941-4103-bf35-c317262c3f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.597225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437d5d-f941-4103-bf35-c317262c3f3d None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.597900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437d5d-f941-4103-bf35-c317262c3f3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:29.598362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437d5d-f941-4103-bf35-c317262c3f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:29.599780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437d5d-f941-4103-bf35-c317262c3f3d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:29.608599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 158/302] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:29.609806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef294-547e-47b0-aa03-a2b3c85222ad None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.610093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef294-547e-47b0-aa03-a2b3c85222ad None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.610363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ef294-547e-47b0-aa03-a2b3c85222ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.628703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-000ef294-547e-47b0-aa03-a2b3c85222ad None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:29.629875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-000ef294-547e-47b0-aa03-a2b3c85222ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:29.678084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a0345-e344-41e6-afd2-da68adc3e184 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:29.701831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 159/303] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:29.703222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5a16-08cd-4ab3-935b-3ea1dcbb5fb5 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.703573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5a16-08cd-4ab3-935b-3ea1dcbb5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.703850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5a16-08cd-4ab3-935b-3ea1dcbb5fb5 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.705361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 160/304] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:29.706067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb5a16-08cd-4ab3-935b-3ea1dcbb5fb5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:29.718285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c274d7-5ece-4639-b00c-ae947dc00c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:29.718923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c274d7-5ece-4639-b00c-ae947dc00c3e None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.719198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c274d7-5ece-4639-b00c-ae947dc00c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.719463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c274d7-5ece-4639-b00c-ae947dc00c3e None admin] PATH_INFO: `/v3/groups` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.720081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c274d7-5ece-4639-b00c-ae947dc00c3e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:29.721493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c274d7-5ece-4639-b00c-ae947dc00c3e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:29.743330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 145/305] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Sep 24 04:47:29 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:47:29.743330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dacb8-53b0-4e93-aa98-564c66750893 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.743330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dacb8-53b0-4e93-aa98-564c66750893 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.743330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dacb8-53b0-4e93-aa98-564c66750893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.770477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-799dacb8-53b0-4e93-aa98-564c66750893 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:29.771752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-799dacb8-53b0-4e93-aa98-564c66750893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:29.813918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:29.838999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:29.855995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 146/306] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:29.865270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb5a16-08cd-4ab3-935b-3ea1dcbb5fb5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:29.907408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd65e1-fb4f-4995-ba47-11bd44847f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:29.908052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd65e1-fb4f-4995-ba47-11bd44847f0a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:29.908327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd65e1-fb4f-4995-ba47-11bd44847f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:29.908647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd65e1-fb4f-4995-ba47-11bd44847f0a None admin] PATH_INFO: `/v3/users/614a2574a8e34832b8dc3ae6a0a77f99` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:29.925043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd65e1-fb4f-4995-ba47-11bd44847f0a None admin] RBAC: Authorizing `identity:get_user(user_id=614a2574a8e34832b8dc3ae6a0a77f99)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:29.926561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd65e1-fb4f-4995-ba47-11bd44847f0a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:29.928680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 161/307] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:29 2022] GET /identity/v3/users/614a2574a8e34832b8dc3ae6a0a77f99 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:29.935931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dacb8-53b0-4e93-aa98-564c66750893 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:29.984082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd65e1-fb4f-4995-ba47-11bd44847f0a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:30.048075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dacb8-53b0-4e93-aa98-564c66750893 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.088927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.089535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.089812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.090084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.090834 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] RBAC: Adding query filter params (role.id=68ce6057586947a4abce25fb4a5752ab, user.id=614a2574a8e34832b8dc3ae6a0a77f99, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:30.091143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:30.092570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:30.098794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 147/308] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Sep 24 04:47:29 2022] GET /identity/v3/role_assignments?user.id=614a2574a8e34832b8dc3ae6a0a77f99&scope.system=all&role.id=68ce6057586947a4abce25fb4a5752ab => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:30.118406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd65e1-fb4f-4995-ba47-11bd44847f0a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.133049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:30.158203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:30.166911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e6d19-fdb6-4304-a642-c58ac4fc2759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.168038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6d19-fdb6-4304-a642-c58ac4fc2759 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.168526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6d19-fdb6-4304-a642-c58ac4fc2759 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.168974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6d19-fdb6-4304-a642-c58ac4fc2759 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.181734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e6d19-fdb6-4304-a642-c58ac4fc2759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-707e6d19-fdb6-4304-a642-c58ac4fc2759 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:30.187733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:30.188681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:30.189518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:30.192096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 162/309] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:30.198397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e6d19-fdb6-4304-a642-c58ac4fc2759 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:30.199569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:30.249345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fe980-6ea0-474c-8c30-3bd5bf8c89e7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.291486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0316d3-607a-4420-a11b-8232a5836521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.292300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0316d3-607a-4420-a11b-8232a5836521 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.292678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0316d3-607a-4420-a11b-8232a5836521 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.293047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0316d3-607a-4420-a11b-8232a5836521 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.313431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0316d3-607a-4420-a11b-8232a5836521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7a0316d3-607a-4420-a11b-8232a5836521 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:30.318073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:30.319225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:30.320071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 148/310] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:30.326447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0316d3-607a-4420-a11b-8232a5836521 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:30.337963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e6d19-fdb6-4304-a642-c58ac4fc2759 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.382785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.383768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.384043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.384321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.384997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:30.385306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:30.386891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:30.397555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 163/311] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:30.404255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:30.454767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0316d3-607a-4420-a11b-8232a5836521 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.473584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:30.475812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:30.503525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.504402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.504822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.505232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.506067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:30.507134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:30.509744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:30.524571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 149/312] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:30.525996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:30.537656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4be3f-73b8-42d0-af8f-de842c203942 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.576376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ede4-6f96-47ee-84ee-b454a1baa41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.577313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ede4-6f96-47ee-84ee-b454a1baa41d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.577734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ede4-6f96-47ee-84ee-b454a1baa41d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.578237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ede4-6f96-47ee-84ee-b454a1baa41d None admin] PATH_INFO: `/v3/users/ad9c28eec5264f85b18110b13f71f083` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.579621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85ede4-6f96-47ee-84ee-b454a1baa41d None admin] RBAC: Authorizing `identity:get_user(user_id=ad9c28eec5264f85b18110b13f71f083)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:30.581236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85ede4-6f96-47ee-84ee-b454a1baa41d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:30.583130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 164/313] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:30 2022] GET /identity/v3/users/ad9c28eec5264f85b18110b13f71f083 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:30.591838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ede4-6f96-47ee-84ee-b454a1baa41d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:30.649109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97f85c-3507-467f-9681-dc1ad1379f09 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.692157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e56b-e4f2-4e86-9000-6c9c371fff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.693228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e56b-e4f2-4e86-9000-6c9c371fff0c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.693691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e56b-e4f2-4e86-9000-6c9c371fff0c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.694135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e56b-e4f2-4e86-9000-6c9c371fff0c None admin] PATH_INFO: `/v3/users/2b40bab7a3234f2e8331e004a0221e30` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.695465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e56b-e4f2-4e86-9000-6c9c371fff0c None admin] RBAC: Authorizing `identity:get_user(user_id=2b40bab7a3234f2e8331e004a0221e30)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:30.697854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e56b-e4f2-4e86-9000-6c9c371fff0c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:30.700131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 150/314] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:30 2022] GET /identity/v3/users/2b40bab7a3234f2e8331e004a0221e30 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:30.710802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e56b-e4f2-4e86-9000-6c9c371fff0c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:30.710961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ede4-6f96-47ee-84ee-b454a1baa41d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.735734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:30.755619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c2b9-60b0-40b1-b238-c916ad7a865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.756232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c2b9-60b0-40b1-b238-c916ad7a865f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.756508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c2b9-60b0-40b1-b238-c916ad7a865f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.756776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c2b9-60b0-40b1-b238-c916ad7a865f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.772169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:30.829980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9c2b9-60b0-40b1-b238-c916ad7a865f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:30.831868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9c2b9-60b0-40b1-b238-c916ad7a865f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:30.844076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e56b-e4f2-4e86-9000-6c9c371fff0c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:30.885217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73320218-db24-413d-b14d-783bc777ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:30.886319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73320218-db24-413d-b14d-783bc777ddda None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:30.886840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73320218-db24-413d-b14d-783bc777ddda None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:30.887340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73320218-db24-413d-b14d-783bc777ddda None admin] PATH_INFO: `/v3/system/users/2b40bab7a3234f2e8331e004a0221e30/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:30.889126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73320218-db24-413d-b14d-783bc777ddda None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2b40bab7a3234f2e8331e004a0221e30, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:30.890690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73320218-db24-413d-b14d-783bc777ddda None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:30.907129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 151/315] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Sep 24 04:47:30 2022] PUT /identity/v3/system/users/2b40bab7a3234f2e8331e004a0221e30/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:30.954033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 165/316] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 04:47:30.959575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73320218-db24-413d-b14d-783bc777ddda None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:31.081028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73320218-db24-413d-b14d-783bc777ddda None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:31.090929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:31.121839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8009ba-3cf7-470f-a35d-3779c86cc1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:31.123098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8009ba-3cf7-470f-a35d-3779c86cc1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:31.123604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8009ba-3cf7-470f-a35d-3779c86cc1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:31.124071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8009ba-3cf7-470f-a35d-3779c86cc1b7 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:31.125387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8009ba-3cf7-470f-a35d-3779c86cc1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:31.127034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8009ba-3cf7-470f-a35d-3779c86cc1b7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:31.129413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 152/317] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:30 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:31.135763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c2b9-60b0-40b1-b238-c916ad7a865f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:31.157994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:31.241439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c2b9-60b0-40b1-b238-c916ad7a865f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:31.278221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a9524-1512-4ccd-a7e9-7aac8c1c9698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:31.278902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a9524-1512-4ccd-a7e9-7aac8c1c9698 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:31.279235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a9524-1512-4ccd-a7e9-7aac8c1c9698 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:31.279506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a9524-1512-4ccd-a7e9-7aac8c1c9698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:31.280343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a9524-1512-4ccd-a7e9-7aac8c1c9698 None admin] RBAC: Adding query filter params (role.id=68ce6057586947a4abce25fb4a5752ab, scope.project.id=4e3eb031806d4c758fdf3846558516d7, user.id=ad9c28eec5264f85b18110b13f71f083) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:31.280658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a9524-1512-4ccd-a7e9-7aac8c1c9698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:31.282170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a9524-1512-4ccd-a7e9-7aac8c1c9698 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:31.288378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 166/318] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:47:31 2022] GET /identity/v3/role_assignments?user.id=ad9c28eec5264f85b18110b13f71f083&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=68ce6057586947a4abce25fb4a5752ab => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:32.048211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb062-36f8-4a4c-abcc-135cb885fbf8 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:32.048780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb062-36f8-4a4c-abcc-135cb885fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:32.048780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb062-36f8-4a4c-abcc-135cb885fbf8 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:32.050791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 153/319] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:32.055566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249068-b2fa-4c94-8856-94ffdccd8836 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:32.055972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249068-b2fa-4c94-8856-94ffdccd8836 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:32.056134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249068-b2fa-4c94-8856-94ffdccd8836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:32.074547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2b249068-b2fa-4c94-8856-94ffdccd8836 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:32.075756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2b249068-b2fa-4c94-8856-94ffdccd8836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:32.142712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 167/320] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:32.378473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19da2-6186-4d11-a1e0-1fd5325fbc70 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:32.378828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19da2-6186-4d11-a1e0-1fd5325fbc70 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:32.379005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19da2-6186-4d11-a1e0-1fd5325fbc70 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:32.380339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 154/321] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:32.385892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0e1ea-0cde-478a-bf94-74ba4b5cf394 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:32.386181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0e1ea-0cde-478a-bf94-74ba4b5cf394 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:32.386455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0e1ea-0cde-478a-bf94-74ba4b5cf394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:32.405480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e5e0e1ea-0cde-478a-bf94-74ba4b5cf394 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:32.406656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e5e0e1ea-0cde-478a-bf94-74ba4b5cf394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:32.408889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19da2-6186-4d11-a1e0-1fd5325fbc70 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:32.418270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:32.487779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 168/322] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:32.516937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19da2-6186-4d11-a1e0-1fd5325fbc70 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:32.551848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f83a-42c4-4d7f-a545-92df41e8f548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:32.552670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f83a-42c4-4d7f-a545-92df41e8f548 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:32.553119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f83a-42c4-4d7f-a545-92df41e8f548 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:32.553532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f83a-42c4-4d7f-a545-92df41e8f548 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:32.554779 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3f83a-42c4-4d7f-a545-92df41e8f548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:32.556992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3f83a-42c4-4d7f-a545-92df41e8f548 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:32.562801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 155/323] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:32.564268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0e1ea-0cde-478a-bf94-74ba4b5cf394 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:32.670441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0e1ea-0cde-478a-bf94-74ba4b5cf394 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:32.704876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0270-78e0-4108-9dff-c796de5dc731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:32.705475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0270-78e0-4108-9dff-c796de5dc731 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:32.705744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0270-78e0-4108-9dff-c796de5dc731 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:32.706007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0270-78e0-4108-9dff-c796de5dc731 None admin] PATH_INFO: `/v3/groups` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:32.706634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd0270-78e0-4108-9dff-c796de5dc731 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:32.708061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd0270-78e0-4108-9dff-c796de5dc731 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:32.725591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 169/324] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Sep 24 04:47:32 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:47:32.761489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f83a-42c4-4d7f-a545-92df41e8f548 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:32.811720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:32.873195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f83a-42c4-4d7f-a545-92df41e8f548 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:32.915990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1802d-e1bf-4b6a-ad1d-a285cd4915a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:32.916530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1802d-e1bf-4b6a-ad1d-a285cd4915a5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:32.916809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1802d-e1bf-4b6a-ad1d-a285cd4915a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:32.917083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1802d-e1bf-4b6a-ad1d-a285cd4915a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:32.927419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1802d-e1bf-4b6a-ad1d-a285cd4915a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-66f1802d-e1bf-4b6a-ad1d-a285cd4915a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:32.933656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:32.934538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:32.935351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 156/325] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:32.941992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0270-78e0-4108-9dff-c796de5dc731 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:32.946471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:33.055858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0270-78e0-4108-9dff-c796de5dc731 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:33.093046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75e41d-3eff-4c0b-b672-bd4b02f4448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:33.093648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e41d-3eff-4c0b-b672-bd4b02f4448f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:33.093929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e41d-3eff-4c0b-b672-bd4b02f4448f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:33.094202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e41d-3eff-4c0b-b672-bd4b02f4448f None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:33.095812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75e41d-3eff-4c0b-b672-bd4b02f4448f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:33.095812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75e41d-3eff-4c0b-b672-bd4b02f4448f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:33.096565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75e41d-3eff-4c0b-b672-bd4b02f4448f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:33.105642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 170/326] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:33.111679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1802d-e1bf-4b6a-ad1d-a285cd4915a5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:33.141761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72fa3-590a-4b42-ab41-c389a9f6f4a1 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:33.142081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72fa3-590a-4b42-ab41-c389a9f6f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:33.142308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72fa3-590a-4b42-ab41-c389a9f6f4a1 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:33.143951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 171/327] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:33.150239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a67a-4da6-4c13-bdde-75317ace8afc None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:33.150517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a67a-4da6-4c13-bdde-75317ace8afc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:33.150819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a67a-4da6-4c13-bdde-75317ace8afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:33.174940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1578a67a-4da6-4c13-bdde-75317ace8afc None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:33.176523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1578a67a-4da6-4c13-bdde-75317ace8afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:33.239430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1802d-e1bf-4b6a-ad1d-a285cd4915a5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:33.244944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:33.262798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:33.274173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 172/328] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:33.297543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d16ba9-f645-42b3-9a25-7fbadcc7220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:33.298238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d16ba9-f645-42b3-9a25-7fbadcc7220b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:33.298518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d16ba9-f645-42b3-9a25-7fbadcc7220b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:33.298816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d16ba9-f645-42b3-9a25-7fbadcc7220b None admin] PATH_INFO: `/v3/users/614a2574a8e34832b8dc3ae6a0a77f99` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:33.300010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d16ba9-f645-42b3-9a25-7fbadcc7220b None admin] RBAC: Authorizing `identity:get_user(user_id=614a2574a8e34832b8dc3ae6a0a77f99)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:33.301450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d16ba9-f645-42b3-9a25-7fbadcc7220b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:33.303504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 157/329] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:33 2022] GET /identity/v3/users/614a2574a8e34832b8dc3ae6a0a77f99 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:33.310407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578a67a-4da6-4c13-bdde-75317ace8afc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:33.418014 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578a67a-4da6-4c13-bdde-75317ace8afc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:33.454363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b263e8-c4dc-45c4-81af-d29b988297c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:33.454974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b263e8-c4dc-45c4-81af-d29b988297c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:33.455385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b263e8-c4dc-45c4-81af-d29b988297c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:33.455664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b263e8-c4dc-45c4-81af-d29b988297c4 None admin] PATH_INFO: `/v3/system/users/614a2574a8e34832b8dc3ae6a0a77f99/roles/68ce6057586947a4abce25fb4a5752ab` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:33.457096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b263e8-c4dc-45c4-81af-d29b988297c4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=614a2574a8e34832b8dc3ae6a0a77f99, role_id=68ce6057586947a4abce25fb4a5752ab)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:33.458525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b263e8-c4dc-45c4-81af-d29b988297c4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:33.473864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 173/330] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Sep 24 04:47:33 2022] PUT /identity/v3/system/users/614a2574a8e34832b8dc3ae6a0a77f99/roles/68ce6057586947a4abce25fb4a5752ab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:33.594967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d16ba9-f645-42b3-9a25-7fbadcc7220b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:33.729418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d16ba9-f645-42b3-9a25-7fbadcc7220b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:33.767715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40870f-a9b7-4d7e-8d3b-66b902679ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:33.768349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40870f-a9b7-4d7e-8d3b-66b902679ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:33.768622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40870f-a9b7-4d7e-8d3b-66b902679ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:33.768891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40870f-a9b7-4d7e-8d3b-66b902679ba6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:33.779715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40870f-a9b7-4d7e-8d3b-66b902679ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9f40870f-a9b7-4d7e-8d3b-66b902679ba6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:33.785240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:33.786138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:33.786978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 158/331] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:33.793191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b263e8-c4dc-45c4-81af-d29b988297c4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:33.860331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:33.905201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b263e8-c4dc-45c4-81af-d29b988297c4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:33.944788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:33.945449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:33.945762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:33.946032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:33.946818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:33.947136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:33.948521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:33.961767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 174/332] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:33.967736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40870f-a9b7-4d7e-8d3b-66b902679ba6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:34.002302 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:34.085976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40870f-a9b7-4d7e-8d3b-66b902679ba6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:34.131999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d429707-5c9e-4a76-a0a0-264e71f9778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:34.132655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429707-5c9e-4a76-a0a0-264e71f9778a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:34.132901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429707-5c9e-4a76-a0a0-264e71f9778a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:34.133235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429707-5c9e-4a76-a0a0-264e71f9778a None admin] PATH_INFO: `/v3/users/2b40bab7a3234f2e8331e004a0221e30` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:34.134424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d429707-5c9e-4a76-a0a0-264e71f9778a None admin] RBAC: Authorizing `identity:get_user(user_id=2b40bab7a3234f2e8331e004a0221e30)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:34.135919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d429707-5c9e-4a76-a0a0-264e71f9778a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:34.137561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 159/333] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:33 2022] GET /identity/v3/users/2b40bab7a3234f2e8331e004a0221e30 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:34.143373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:34.259707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d8c4-b20e-4987-ada2-060fea9e045b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:34.285020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:34.298631 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c9817-b764-4c5d-a753-f0f8d0c5d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:34.299267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9817-b764-4c5d-a753-f0f8d0c5d21c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:34.299540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9817-b764-4c5d-a753-f0f8d0c5d21c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:34.299807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9817-b764-4c5d-a753-f0f8d0c5d21c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:34.300532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c9817-b764-4c5d-a753-f0f8d0c5d21c None admin] RBAC: Adding query filter params (role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, user.id=2b40bab7a3234f2e8331e004a0221e30, scope.system=all) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:34.300835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c9817-b764-4c5d-a753-f0f8d0c5d21c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:34.302315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c9817-b764-4c5d-a753-f0f8d0c5d21c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:34.315074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 175/334] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Sep 24 04:47:34 2022] GET /identity/v3/role_assignments?user.id=2b40bab7a3234f2e8331e004a0221e30&scope.system=all&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:35.907577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9af7d-bfa9-4192-889d-8a21acf50bac None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:35.908124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9af7d-bfa9-4192-889d-8a21acf50bac None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:35.908124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9af7d-bfa9-4192-889d-8a21acf50bac None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:35.909809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 160/335] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:35.920737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3220c-62c7-499a-9484-db91f5a396e9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:35.921224 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3220c-62c7-499a-9484-db91f5a396e9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:35.921326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3220c-62c7-499a-9484-db91f5a396e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:35.944694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fbc3220c-62c7-499a-9484-db91f5a396e9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:35.946488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fbc3220c-62c7-499a-9484-db91f5a396e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:36.036328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 176/336] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:36.515886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ab0b-f339-44a4-ba8a-35ab01fb5cd1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:36.516156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ab0b-f339-44a4-ba8a-35ab01fb5cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:36.516623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ab0b-f339-44a4-ba8a-35ab01fb5cd1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:36.518446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 161/337] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:36.520807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219dbd-f48b-4e9f-97e5-d264cb1ac7ca None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:36.521251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219dbd-f48b-4e9f-97e5-d264cb1ac7ca None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:36.521655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219dbd-f48b-4e9f-97e5-d264cb1ac7ca None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:36.523501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f6bd-8395-4e01-9684-f7240693677b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:36.524009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f6bd-8395-4e01-9684-f7240693677b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:36.524417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f6bd-8395-4e01-9684-f7240693677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:36.531801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 177/338] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:36.544898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b9985-c9ff-4d04-aa44-6b213f11e991 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:36.545404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b9985-c9ff-4d04-aa44-6b213f11e991 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:36.545809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b9985-c9ff-4d04-aa44-6b213f11e991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:36.554169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4a94f6bd-8395-4e01-9684-f7240693677b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:36.557831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4a94f6bd-8395-4e01-9684-f7240693677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:36.579831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-550b9985-c9ff-4d04-aa44-6b213f11e991 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:36.581289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-550b9985-c9ff-4d04-aa44-6b213f11e991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:36.672884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 162/339] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:36.675425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26cc84-04f0-4abc-9f47-787b426e5cb3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:36.675860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26cc84-04f0-4abc-9f47-787b426e5cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:36.676414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26cc84-04f0-4abc-9f47-787b426e5cb3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:36.678258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 163/340] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:36.679207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26cc84-04f0-4abc-9f47-787b426e5cb3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:36.684886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 178/341] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:36.686210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96396c2f-bf58-466e-a172-0284750c984f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:36.686490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96396c2f-bf58-466e-a172-0284750c984f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:36.686774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96396c2f-bf58-466e-a172-0284750c984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:36.715185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:36.727700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-96396c2f-bf58-466e-a172-0284750c984f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:36.728891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-96396c2f-bf58-466e-a172-0284750c984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:36.798707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26cc84-04f0-4abc-9f47-787b426e5cb3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:36.816797 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:36.838635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5baa38-79da-48fe-8bcf-a21106fad2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:36.839540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5baa38-79da-48fe-8bcf-a21106fad2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:36.839965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5baa38-79da-48fe-8bcf-a21106fad2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:36.840621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5baa38-79da-48fe-8bcf-a21106fad2d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:36.852484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5baa38-79da-48fe-8bcf-a21106fad2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8e5baa38-79da-48fe-8bcf-a21106fad2d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:36.857729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:36.858815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:36.859784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:36.861753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 164/342] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:36.869290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5baa38-79da-48fe-8bcf-a21106fad2d8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:36.896061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 179/343] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:36.969022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:36.979445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5baa38-79da-48fe-8bcf-a21106fad2d8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:37.030971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:37.031578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.031854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.032120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.032781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:37.033078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:37.034445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:37.053124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 165/344] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:37.059121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96396c2f-bf58-466e-a172-0284750c984f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:37.105798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:37.192876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96396c2f-bf58-466e-a172-0284750c984f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:37.236495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f479e-41ee-4819-9a5a-c225a89d3c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:37.237675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f479e-41ee-4819-9a5a-c225a89d3c5c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.238200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f479e-41ee-4819-9a5a-c225a89d3c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.238852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f479e-41ee-4819-9a5a-c225a89d3c5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.278366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5ccab-9ff2-4639-885e-09db0c997d36 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:37.298203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:37.326860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee747-c45f-443a-ab7b-3d10e30c1f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:37.327405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee747-c45f-443a-ab7b-3d10e30c1f87 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.327679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee747-c45f-443a-ab7b-3d10e30c1f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.327945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee747-c45f-443a-ab7b-3d10e30c1f87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.332055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f479e-41ee-4819-9a5a-c225a89d3c5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:37.333583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f479e-41ee-4819-9a5a-c225a89d3c5c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:37.342145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee747-c45f-443a-ab7b-3d10e30c1f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-650ee747-c45f-443a-ab7b-3d10e30c1f87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:37.347911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:37.348793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:37.349622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 166/345] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:37.350278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee747-c45f-443a-ab7b-3d10e30c1f87 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:37.375105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:37.465812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 180/346] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:37.467266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6708-bb69-4a18-9eb4-f9641910a2cb None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.467555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6708-bb69-4a18-9eb4-f9641910a2cb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.467818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6708-bb69-4a18-9eb4-f9641910a2cb None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.469268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 181/347] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:37.471796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a6708-bb69-4a18-9eb4-f9641910a2cb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:37.476367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee747-c45f-443a-ab7b-3d10e30c1f87 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:37.519539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e37976-a5f9-4356-ad26-fbdcbeb0bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:37.520167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37976-a5f9-4356-ad26-fbdcbeb0bab9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.520443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37976-a5f9-4356-ad26-fbdcbeb0bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.520707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37976-a5f9-4356-ad26-fbdcbeb0bab9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.535710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e37976-a5f9-4356-ad26-fbdcbeb0bab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e2e37976-a5f9-4356-ad26-fbdcbeb0bab9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:37.542164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:37.543165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:37.543981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 167/348] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:37.545113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e37976-a5f9-4356-ad26-fbdcbeb0bab9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:37.565127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:37.605414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a6708-bb69-4a18-9eb4-f9641910a2cb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:37.627333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:37.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52366-de4e-41d8-8d26-f77ba2ecba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:37.655714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52366-de4e-41d8-8d26-f77ba2ecba2e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.656111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52366-de4e-41d8-8d26-f77ba2ecba2e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.656477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52366-de4e-41d8-8d26-f77ba2ecba2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.669399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac52366-de4e-41d8-8d26-f77ba2ecba2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:37.669671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e37976-a5f9-4356-ad26-fbdcbeb0bab9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-0ac52366-de4e-41d8-8d26-f77ba2ecba2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:37.675101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:37.676220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:37.677207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:37.678806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 182/349] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:37.680717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52366-de4e-41d8-8d26-f77ba2ecba2e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:37.712459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df80401-5ddb-4ff8-b144-619a81006ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:37.713353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80401-5ddb-4ff8-b144-619a81006ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.713784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80401-5ddb-4ff8-b144-619a81006ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.714054 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80401-5ddb-4ff8-b144-619a81006ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.714716 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df80401-5ddb-4ff8-b144-619a81006ad1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:37.715053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df80401-5ddb-4ff8-b144-619a81006ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:37.716475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df80401-5ddb-4ff8-b144-619a81006ad1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:37.729491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 168/350] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:37.729664 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3705c5-b674-42ce-92e3-75c382139d06 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.729891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3705c5-b674-42ce-92e3-75c382139d06 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.730160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3705c5-b674-42ce-92e3-75c382139d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.757374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0c3705c5-b674-42ce-92e3-75c382139d06 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:37.759766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0c3705c5-b674-42ce-92e3-75c382139d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:37.811907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52366-de4e-41d8-8d26-f77ba2ecba2e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:37.850476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 169/351] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:37.851325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3705c5-b674-42ce-92e3-75c382139d06 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:37.851839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:37.861122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dea5f-2de5-4d55-a3f1-07e7685bed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:37.862447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dea5f-2de5-4d55-a3f1-07e7685bed6a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:37.862726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dea5f-2de5-4d55-a3f1-07e7685bed6a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:37.863056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dea5f-2de5-4d55-a3f1-07e7685bed6a None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:37.864662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dea5f-2de5-4d55-a3f1-07e7685bed6a None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:37.866862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dea5f-2de5-4d55-a3f1-07e7685bed6a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:37.869248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 183/352] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:37 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:37.870032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dea5f-2de5-4d55-a3f1-07e7685bed6a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:37.931618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:37.973621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3705c5-b674-42ce-92e3-75c382139d06 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.007326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dea5f-2de5-4d55-a3f1-07e7685bed6a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.013399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.014009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.014281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.014548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.015249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:38.015648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.017022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:38.026613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 170/353] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:38.027469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.045252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.045908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.046187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.046513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.047777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:38.048191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.049628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:38.059054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 184/354] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:38.059937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.129028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:38.137947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a0136-b4b8-4004-89e8-58f16b2bb7e3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.165471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:38.175014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214c0c-5cdc-4744-a7c3-8a82575f1999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.175694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214c0c-5cdc-4744-a7c3-8a82575f1999 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.176028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214c0c-5cdc-4744-a7c3-8a82575f1999 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.176370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214c0c-5cdc-4744-a7c3-8a82575f1999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.179442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e2c58-61f3-4ae9-9f2d-d1ccd9a65cbd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.220837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627eb42-6cc6-4d68-a9c2-406d96afecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.221821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627eb42-6cc6-4d68-a9c2-406d96afecc2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.222253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627eb42-6cc6-4d68-a9c2-406d96afecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.222667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627eb42-6cc6-4d68-a9c2-406d96afecc2 None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.230447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627eb42-6cc6-4d68-a9c2-406d96afecc2 None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.231977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627eb42-6cc6-4d68-a9c2-406d96afecc2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:38.233848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 185/355] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:38.237109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627eb42-6cc6-4d68-a9c2-406d96afecc2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.268993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214c0c-5cdc-4744-a7c3-8a82575f1999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.270443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214c0c-5cdc-4744-a7c3-8a82575f1999 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:38.356284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627eb42-6cc6-4d68-a9c2-406d96afecc2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.386037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:38.395180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 171/356] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:38.396228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214c0c-5cdc-4744-a7c3-8a82575f1999 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.398875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db89467-17df-4c6c-86f3-6d25b71278c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.399689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db89467-17df-4c6c-86f3-6d25b71278c8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.399921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db89467-17df-4c6c-86f3-6d25b71278c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.400194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db89467-17df-4c6c-86f3-6d25b71278c8 None admin] PATH_INFO: `/v3/users/614a2574a8e34832b8dc3ae6a0a77f99` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.401363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db89467-17df-4c6c-86f3-6d25b71278c8 None admin] RBAC: Authorizing `identity:get_user(user_id=614a2574a8e34832b8dc3ae6a0a77f99)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.402846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db89467-17df-4c6c-86f3-6d25b71278c8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:38.404425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 186/357] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/users/614a2574a8e34832b8dc3ae6a0a77f99 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:38.405242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db89467-17df-4c6c-86f3-6d25b71278c8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.427259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:38.522276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214c0c-5cdc-4744-a7c3-8a82575f1999 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.524131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db89467-17df-4c6c-86f3-6d25b71278c8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.562355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d372be-adee-4385-90ad-a2d83d2a44c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.563187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d2c5-5200-44b1-a0e2-9294ec58889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.563355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d372be-adee-4385-90ad-a2d83d2a44c4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.563548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d372be-adee-4385-90ad-a2d83d2a44c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.563791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d2c5-5200-44b1-a0e2-9294ec58889f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.563918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d372be-adee-4385-90ad-a2d83d2a44c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.564067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d2c5-5200-44b1-a0e2-9294ec58889f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.564337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d2c5-5200-44b1-a0e2-9294ec58889f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.577494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d372be-adee-4385-90ad-a2d83d2a44c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b5d372be-adee-4385-90ad-a2d83d2a44c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:38.582886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:38.583933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 187/358] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:38.587681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d372be-adee-4385-90ad-a2d83d2a44c4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.653905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670d2c5-5200-44b1-a0e2-9294ec58889f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.655385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670d2c5-5200-44b1-a0e2-9294ec58889f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:38.661955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:38.689512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:38.721018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d372be-adee-4385-90ad-a2d83d2a44c4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.759702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f9cd0-2aff-4f34-a8da-b7c22421ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.759702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9cd0-2aff-4f34-a8da-b7c22421ff7a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.759983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9cd0-2aff-4f34-a8da-b7c22421ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.760227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f9cd0-2aff-4f34-a8da-b7c22421ff7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.763168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f9cd0-2aff-4f34-a8da-b7c22421ff7a None admin] RBAC: Adding query filter params (group.id=dce09959c6d845cb803c48caea281c9e, role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:38.763168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f9cd0-2aff-4f34-a8da-b7c22421ff7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.763168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f9cd0-2aff-4f34-a8da-b7c22421ff7a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:38.769146 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 188/359] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/role_assignments?group.id=dce09959c6d845cb803c48caea281c9e&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:38.770856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c907-81fd-4ee5-8cc4-89df8e7a4a5f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.770856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c907-81fd-4ee5-8cc4-89df8e7a4a5f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.770856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c907-81fd-4ee5-8cc4-89df8e7a4a5f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.771864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 189/360] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:38.772577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c907-81fd-4ee5-8cc4-89df8e7a4a5f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.796109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 172/361] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:38.796978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d2c5-5200-44b1-a0e2-9294ec58889f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.912257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c907-81fd-4ee5-8cc4-89df8e7a4a5f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.932867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:38.940126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d2c5-5200-44b1-a0e2-9294ec58889f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:38.964136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393c82b-1353-488e-a8f9-4b916df6919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.965058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c82b-1353-488e-a8f9-4b916df6919b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.965503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c82b-1353-488e-a8f9-4b916df6919b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.965774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c82b-1353-488e-a8f9-4b916df6919b None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.966966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393c82b-1353-488e-a8f9-4b916df6919b None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.968410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393c82b-1353-488e-a8f9-4b916df6919b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:38.970046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 190/362] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:38.971900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393c82b-1353-488e-a8f9-4b916df6919b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:38.980789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:38.990912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2021d-cfa0-4815-b4f9-d04d22cfb0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:38.991800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2021d-cfa0-4815-b4f9-d04d22cfb0de None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:38.992454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2021d-cfa0-4815-b4f9-d04d22cfb0de None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:38.993142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2021d-cfa0-4815-b4f9-d04d22cfb0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:38.993880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2021d-cfa0-4815-b4f9-d04d22cfb0de None admin] RBAC: Adding query filter params (role.id=68ce6057586947a4abce25fb4a5752ab, user.id=614a2574a8e34832b8dc3ae6a0a77f99, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:38.994182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2021d-cfa0-4815-b4f9-d04d22cfb0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:38.996630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2021d-cfa0-4815-b4f9-d04d22cfb0de None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:39.015511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 173/363] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/role_assignments?user.id=614a2574a8e34832b8dc3ae6a0a77f99&scope.system=all&role.id=68ce6057586947a4abce25fb4a5752ab => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:39.016555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6f80-0154-47c2-b566-36de870d33dd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.016838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6f80-0154-47c2-b566-36de870d33dd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.017218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6f80-0154-47c2-b566-36de870d33dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.040186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b4cf6f80-0154-47c2-b566-36de870d33dd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:39.041583 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b4cf6f80-0154-47c2-b566-36de870d33dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:39.098783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393c82b-1353-488e-a8f9-4b916df6919b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:39.131047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 174/364] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:39.131929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf6f80-0154-47c2-b566-36de870d33dd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:39.144898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:39.145975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.146458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.146982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.147870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:39.148429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:39.150823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:39.163608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 191/365] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:39.164990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:39.233682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:39.244774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf6f80-0154-47c2-b566-36de870d33dd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:39.262341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:39.286816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448d20-fb1d-4f8f-8895-e388e0bbbb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:39.287792 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448d20-fb1d-4f8f-8895-e388e0bbbb6c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.288732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448d20-fb1d-4f8f-8895-e388e0bbbb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.289304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448d20-fb1d-4f8f-8895-e388e0bbbb6c None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.291121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448d20-fb1d-4f8f-8895-e388e0bbbb6c None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:39.293224 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448d20-fb1d-4f8f-8895-e388e0bbbb6c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:39.295757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 175/366] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:39.296931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448d20-fb1d-4f8f-8895-e388e0bbbb6c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:39.327585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f4eef-f764-4112-b83b-a7e1246a5668 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:39.381586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd50cf-cf06-46a7-8586-d319efbb55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:39.382231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd50cf-cf06-46a7-8586-d319efbb55d9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.382509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd50cf-cf06-46a7-8586-d319efbb55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.382859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd50cf-cf06-46a7-8586-d319efbb55d9 None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.384988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd50cf-cf06-46a7-8586-d319efbb55d9 None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:39.386594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd50cf-cf06-46a7-8586-d319efbb55d9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:39.388222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 192/367] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:39.392831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd50cf-cf06-46a7-8586-d319efbb55d9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:39.413530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448d20-fb1d-4f8f-8895-e388e0bbbb6c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:39.458384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bea7-d349-467f-8197-4e5cdcf3f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:39.458895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bea7-d349-467f-8197-4e5cdcf3f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.459149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bea7-d349-467f-8197-4e5cdcf3f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.459411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bea7-d349-467f-8197-4e5cdcf3f1f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.512703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd50cf-cf06-46a7-8586-d319efbb55d9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:39.518127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:39.531043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:39.539463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bea7-d349-467f-8197-4e5cdcf3f1f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:39.540911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bea7-d349-467f-8197-4e5cdcf3f1f1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:39.556387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f218-48f5-40f6-af15-ecfb318f577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:39.557039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f218-48f5-40f6-af15-ecfb318f577f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.557317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f218-48f5-40f6-af15-ecfb318f577f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.557587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f218-48f5-40f6-af15-ecfb318f577f None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.559124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f218-48f5-40f6-af15-ecfb318f577f None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:39.560575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f218-48f5-40f6-af15-ecfb318f577f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:39.562158 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 193/368] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:39.562956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f218-48f5-40f6-af15-ecfb318f577f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:39.673957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 176/369] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:39.674850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bea7-d349-467f-8197-4e5cdcf3f1f1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:39.689664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f218-48f5-40f6-af15-ecfb318f577f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:39.736138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:39.736665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.736945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.737200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.737920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] RBAC: Adding query filter params (group.id=dce09959c6d845cb803c48caea281c9e, role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=4e3eb031806d4c758fdf3846558516d7) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:39.738300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:39.739890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:39.745455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 194/370] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/role_assignments?group.id=dce09959c6d845cb803c48caea281c9e&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:39.751774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:39.795244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:39.829779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:39.842112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bea7-d349-467f-8197-4e5cdcf3f1f1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:39.897593 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbbd80-7eb8-4cc2-b49d-fce5ac7966ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:39.898233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbbd80-7eb8-4cc2-b49d-fce5ac7966ed None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.898548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbbd80-7eb8-4cc2-b49d-fce5ac7966ed None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.900061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbbd80-7eb8-4cc2-b49d-fce5ac7966ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.902152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba053-9eed-4345-8c96-612443e4e433 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:39.914236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbbd80-7eb8-4cc2-b49d-fce5ac7966ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-03dbbd80-7eb8-4cc2-b49d-fce5ac7966ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:39.919920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:39.920843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:39.921627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 177/371] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:39.922344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbbd80-7eb8-4cc2-b49d-fce5ac7966ed None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:39.948133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62673a-d372-4363-a430-2c625e746754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:39.948819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62673a-d372-4363-a430-2c625e746754 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:39.949101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62673a-d372-4363-a430-2c625e746754 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:39.949368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62673a-d372-4363-a430-2c625e746754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:39.950262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62673a-d372-4363-a430-2c625e746754 None admin] RBAC: Adding query filter params (group.id=dce09959c6d845cb803c48caea281c9e, role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:39.950574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62673a-d372-4363-a430-2c625e746754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:39.952062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62673a-d372-4363-a430-2c625e746754 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:39.962812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 195/372] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/role_assignments?group.id=dce09959c6d845cb803c48caea281c9e&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=043adf092a6b422e961a0edc97df0a66 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:39.966902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62673a-d372-4363-a430-2c625e746754 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:40.057136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbbd80-7eb8-4cc2-b49d-fce5ac7966ed None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:40.102360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200cc22-b1e8-4ef3-b249-c5ded0d08be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:40.103429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cc22-b1e8-4ef3-b249-c5ded0d08be2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:40.103888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cc22-b1e8-4ef3-b249-c5ded0d08be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:40.104345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cc22-b1e8-4ef3-b249-c5ded0d08be2 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:40.106392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200cc22-b1e8-4ef3-b249-c5ded0d08be2 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:40.109069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200cc22-b1e8-4ef3-b249-c5ded0d08be2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:40.112335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 178/373] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:40.115218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62673a-d372-4363-a430-2c625e746754 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:40.119020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200cc22-b1e8-4ef3-b249-c5ded0d08be2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:40.131539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:40.138738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:40.172353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:40.172983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:40.173258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:40.173523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:40.174315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:40.174719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:40.176201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:40.187723 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 196/374] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:40.199704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:40.329596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200cc22-b1e8-4ef3-b249-c5ded0d08be2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:40.371157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20740bf3-28b6-4bd4-a32e-4dfe5ba09b7a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:40.397619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef81d3-2817-4c1a-98cd-7d979d6a9354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:40.398260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef81d3-2817-4c1a-98cd-7d979d6a9354 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:40.398547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef81d3-2817-4c1a-98cd-7d979d6a9354 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:40.398855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef81d3-2817-4c1a-98cd-7d979d6a9354 None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:40.400180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef81d3-2817-4c1a-98cd-7d979d6a9354 None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:40.403194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef81d3-2817-4c1a-98cd-7d979d6a9354 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:40.406148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 179/375] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:40 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:40.416050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef81d3-2817-4c1a-98cd-7d979d6a9354 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:40.499488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7291-cb4d-4494-816d-110a01022a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:40.500182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7291-cb4d-4494-816d-110a01022a61 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:40.500460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7291-cb4d-4494-816d-110a01022a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:40.500805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7291-cb4d-4494-816d-110a01022a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:40.542694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:40.590133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:40.592467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef81d3-2817-4c1a-98cd-7d979d6a9354 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:40.650721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e7291-cb4d-4494-816d-110a01022a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:40.652203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e7291-cb4d-4494-816d-110a01022a61 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:40.678006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:40.678676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:40.678967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:40.679238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:40.680051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] RBAC: Adding query filter params (group.id=dce09959c6d845cb803c48caea281c9e, role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=4e3eb031806d4c758fdf3846558516d7) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:40.680360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:40.682247 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:40.698249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 180/376] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:40 2022] GET /identity/v3/role_assignments?group.id=dce09959c6d845cb803c48caea281c9e&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=043adf092a6b422e961a0edc97df0a66 => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:40.834887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 197/377] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:40.842739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:41.000981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3865a6-a03e-46bb-9c23-029a42134531 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:41.052277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0921ea-b0f6-491d-8f47-71e4d2759d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:41.052923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0921ea-b0f6-491d-8f47-71e4d2759d74 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:41.053200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0921ea-b0f6-491d-8f47-71e4d2759d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:41.053466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0921ea-b0f6-491d-8f47-71e4d2759d74 None admin] PATH_INFO: `/v3/projects/8b234c6113f54a018ff39cafffcc9b40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:41.054632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0921ea-b0f6-491d-8f47-71e4d2759d74 None admin] RBAC: Authorizing `identity:get_project(project_id=8b234c6113f54a018ff39cafffcc9b40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:41.056209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0921ea-b0f6-491d-8f47-71e4d2759d74 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:41.058210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 181/378] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:40 2022] GET /identity/v3/projects/8b234c6113f54a018ff39cafffcc9b40 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:41.066359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7291-cb4d-4494-816d-110a01022a61 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:41.165298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:41.209610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7291-cb4d-4494-816d-110a01022a61 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:41.253911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899ea6-46e4-4be7-ad64-82f004872307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:41.254539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899ea6-46e4-4be7-ad64-82f004872307 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:41.254837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899ea6-46e4-4be7-ad64-82f004872307 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:41.255110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899ea6-46e4-4be7-ad64-82f004872307 None admin] PATH_INFO: `/v3/groups/d71cd9c0d4e6404585f7e2c43a57aafb` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:41.262043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899ea6-46e4-4be7-ad64-82f004872307 None admin] RBAC: Authorizing `identity:get_group(group_id=d71cd9c0d4e6404585f7e2c43a57aafb)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:41.263581 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899ea6-46e4-4be7-ad64-82f004872307 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:41.265482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 198/379] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:41 2022] GET /identity/v3/groups/d71cd9c0d4e6404585f7e2c43a57aafb => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:41.275227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0921ea-b0f6-491d-8f47-71e4d2759d74 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:41.294744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:41.396290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0921ea-b0f6-491d-8f47-71e4d2759d74 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:41.442008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4299f7-f619-4b2b-b8ef-6da22849fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:41.442523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4299f7-f619-4b2b-b8ef-6da22849fe7b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:41.442825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4299f7-f619-4b2b-b8ef-6da22849fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:41.443092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4299f7-f619-4b2b-b8ef-6da22849fe7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:41.443810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4299f7-f619-4b2b-b8ef-6da22849fe7b None admin] RBAC: Adding query filter params (group.id=d71cd9c0d4e6404585f7e2c43a57aafb, role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=8b234c6113f54a018ff39cafffcc9b40) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:41.444115 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4299f7-f619-4b2b-b8ef-6da22849fe7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:41.446102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4299f7-f619-4b2b-b8ef-6da22849fe7b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:41.455199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 182/380] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:41 2022] GET /identity/v3/role_assignments?group.id=d71cd9c0d4e6404585f7e2c43a57aafb&scope.project.id=8b234c6113f54a018ff39cafffcc9b40&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:41.681687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e127f6-8fec-45c1-90b3-012d97d02457 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:41.682006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e127f6-8fec-45c1-90b3-012d97d02457 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:41.682237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e127f6-8fec-45c1-90b3-012d97d02457 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:41.683904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 199/381] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:41.689276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7b6f-1f92-48ca-874d-415f795bb53e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:41.689553 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7b6f-1f92-48ca-874d-415f795bb53e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:41.689824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7b6f-1f92-48ca-874d-415f795bb53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:41.716082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-940d7b6f-1f92-48ca-874d-415f795bb53e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:41.717239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-940d7b6f-1f92-48ca-874d-415f795bb53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:41.801990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 183/382] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:42.302405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e127f6-8fec-45c1-90b3-012d97d02457 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:42.436379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e127f6-8fec-45c1-90b3-012d97d02457 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:42.479850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1db47c-829a-402d-8591-0dde57e3ae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:42.480535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db47c-829a-402d-8591-0dde57e3ae2f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:42.480811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db47c-829a-402d-8591-0dde57e3ae2f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:42.481131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db47c-829a-402d-8591-0dde57e3ae2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:42.489493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:42.504752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1db47c-829a-402d-8591-0dde57e3ae2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-fa1db47c-829a-402d-8591-0dde57e3ae2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:42.510527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:42.511387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:42.512169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:42.516120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 200/383] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:42.517338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d7b6f-1f92-48ca-874d-415f795bb53e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:42.520616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:42.521642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa11c-6f58-4905-bb1f-d2f1f965b009 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:42.521928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa11c-6f58-4905-bb1f-d2f1f965b009 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:42.522202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa11c-6f58-4905-bb1f-d2f1f965b009 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:42.528287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 201/384] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:42.533554 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c913-53a4-4440-91f2-30f7b534e0c2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:42.533841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c913-53a4-4440-91f2-30f7b534e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:42.534114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c913-53a4-4440-91f2-30f7b534e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:42.565107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fc63c913-53a4-4440-91f2-30f7b534e0c2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:42.566289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fc63c913-53a4-4440-91f2-30f7b534e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:42.629672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d7b6f-1f92-48ca-874d-415f795bb53e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:42.676332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5769fe5-4c4b-468a-930f-ccc48995e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:42.677254 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5769fe5-4c4b-468a-930f-ccc48995e78e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:42.677755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5769fe5-4c4b-468a-930f-ccc48995e78e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:42.678196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5769fe5-4c4b-468a-930f-ccc48995e78e None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:42.679059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5769fe5-4c4b-468a-930f-ccc48995e78e None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:42.679363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5769fe5-4c4b-468a-930f-ccc48995e78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:42.681123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5769fe5-4c4b-468a-930f-ccc48995e78e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:42.689432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 202/385] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:42.698151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 184/386] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:42.703788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63c913-53a4-4440-91f2-30f7b534e0c2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:42.721558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473062d-ecbb-4ade-8300-3f7bf2a462d9 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:42.722123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473062d-ecbb-4ade-8300-3f7bf2a462d9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:42.722346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473062d-ecbb-4ade-8300-3f7bf2a462d9 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:42.726306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 185/387] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:42.730079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04dad0-7e61-4010-9db8-1199d8935edd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:42.730565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04dad0-7e61-4010-9db8-1199d8935edd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:42.731106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04dad0-7e61-4010-9db8-1199d8935edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:42.766405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fe04dad0-7e61-4010-9db8-1199d8935edd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:42.768634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fe04dad0-7e61-4010-9db8-1199d8935edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:42.866285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63c913-53a4-4440-91f2-30f7b534e0c2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:42.889146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:42.905097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 186/388] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:42.911400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:42.919130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca902373-899a-4af7-bd0a-d1c82f0df306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:42.919763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca902373-899a-4af7-bd0a-d1c82f0df306 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:42.920041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca902373-899a-4af7-bd0a-d1c82f0df306 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:42.920315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca902373-899a-4af7-bd0a-d1c82f0df306 None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:42.921432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca902373-899a-4af7-bd0a-d1c82f0df306 None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:42.922915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca902373-899a-4af7-bd0a-d1c82f0df306 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:42.924800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 203/389] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:42 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:42.930605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04dad0-7e61-4010-9db8-1199d8935edd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:42.989563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca902373-899a-4af7-bd0a-d1c82f0df306 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:43.059501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04dad0-7e61-4010-9db8-1199d8935edd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:43.097250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843d3fb-fd83-41b4-b4e5-6ebf3b52a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:43.097882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d3fb-fd83-41b4-b4e5-6ebf3b52a440 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.098153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d3fb-fd83-41b4-b4e5-6ebf3b52a440 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.098418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d3fb-fd83-41b4-b4e5-6ebf3b52a440 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.099550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843d3fb-fd83-41b4-b4e5-6ebf3b52a440 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:43.101205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843d3fb-fd83-41b4-b4e5-6ebf3b52a440 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:43.104483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 187/390] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:42 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:43.115915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843d3fb-fd83-41b4-b4e5-6ebf3b52a440 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:43.164507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca902373-899a-4af7-bd0a-d1c82f0df306 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:43.195229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:43.213552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d66817-65f7-4f4c-9435-b04bb90e865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:43.214190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d66817-65f7-4f4c-9435-b04bb90e865f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.214467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d66817-65f7-4f4c-9435-b04bb90e865f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.214735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d66817-65f7-4f4c-9435-b04bb90e865f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.222502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843d3fb-fd83-41b4-b4e5-6ebf3b52a440 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:43.231973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d66817-65f7-4f4c-9435-b04bb90e865f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e8d66817-65f7-4f4c-9435-b04bb90e865f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:43.237435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:43.238636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:43.239466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 204/391] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:43.246450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d66817-65f7-4f4c-9435-b04bb90e865f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:43.261643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551d4f1-4ae6-41bb-9bde-9e00fa660211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:43.262381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551d4f1-4ae6-41bb-9bde-9e00fa660211 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.262720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551d4f1-4ae6-41bb-9bde-9e00fa660211 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.263076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551d4f1-4ae6-41bb-9bde-9e00fa660211 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/groups/dce09959c6d845cb803c48caea281c9e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.265163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551d4f1-4ae6-41bb-9bde-9e00fa660211 None admin] RBAC: Authorizing `identity:create_grant(project_id=e164e07e8ca44deda27ca9b205c2a48a, group_id=dce09959c6d845cb803c48caea281c9e, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:43.266837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551d4f1-4ae6-41bb-9bde-9e00fa660211 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:43.294207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 188/392] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 24 04:47:43 2022] PUT /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/groups/dce09959c6d845cb803c48caea281c9e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:43.295118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551d4f1-4ae6-41bb-9bde-9e00fa660211 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:43.378668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:43.439197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d66817-65f7-4f4c-9435-b04bb90e865f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:43.485631 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:43.486590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.487094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.487550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.488640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:43.490031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:43.491717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:43.503139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 205/393] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:43.510976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:43.549292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551d4f1-4ae6-41bb-9bde-9e00fa660211 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:43.589511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:43.604629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db528169-76fb-4ecc-a383-ed0311ffcce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:43.605570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528169-76fb-4ecc-a383-ed0311ffcce0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.606021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528169-76fb-4ecc-a383-ed0311ffcce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.606482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528169-76fb-4ecc-a383-ed0311ffcce0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.617567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db528169-76fb-4ecc-a383-ed0311ffcce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-db528169-76fb-4ecc-a383-ed0311ffcce0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:43.622709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:43.623878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:43.624662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:43.627399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 189/394] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:43.628915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce94ab-5866-4c03-b7c3-b3d30f93bebc None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.629368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce94ab-5866-4c03-b7c3-b3d30f93bebc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.629815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce94ab-5866-4c03-b7c3-b3d30f93bebc None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.634860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 190/395] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:43.635826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce94ab-5866-4c03-b7c3-b3d30f93bebc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:43.650376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaec80-aa0d-445a-9e23-aa28c82aa25e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:43.676181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:43.696841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67725542-fb56-4e38-b8a1-e9b230184d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:43.697995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67725542-fb56-4e38-b8a1-e9b230184d27 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.698519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67725542-fb56-4e38-b8a1-e9b230184d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.699464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67725542-fb56-4e38-b8a1-e9b230184d27 None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.701088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67725542-fb56-4e38-b8a1-e9b230184d27 None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:43.703266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67725542-fb56-4e38-b8a1-e9b230184d27 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:43.705812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 206/396] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:43 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:43.707361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b34e-4196-4aa8-b848-5c146122070c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.707874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b34e-4196-4aa8-b848-5c146122070c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.708304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b34e-4196-4aa8-b848-5c146122070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.731242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-adc3b34e-4196-4aa8-b848-5c146122070c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:43.732400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-adc3b34e-4196-4aa8-b848-5c146122070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:43.767229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce94ab-5866-4c03-b7c3-b3d30f93bebc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:43.801169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 207/397] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:43.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3b34e-4196-4aa8-b848-5c146122070c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:43.814136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:43.815144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:43.815597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:43.816063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:43.817086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:43.823323 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:43.824978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:43.839535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 191/398] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:43.844970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:43.918954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:43.962071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3b34e-4196-4aa8-b848-5c146122070c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:43.992222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:44.017669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585083b-5ebc-4b84-b653-f0795ab10ef6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:44.033812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593d531-6c52-41fc-87f7-e3c16393fddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:44.034447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d531-6c52-41fc-87f7-e3c16393fddf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.034723 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d531-6c52-41fc-87f7-e3c16393fddf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.035029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d531-6c52-41fc-87f7-e3c16393fddf None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.036201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d531-6c52-41fc-87f7-e3c16393fddf None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:44.037623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d531-6c52-41fc-87f7-e3c16393fddf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:44.040179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 208/399] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:43 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:44.046425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593d531-6c52-41fc-87f7-e3c16393fddf None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:44.088214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178e38-3ec8-4570-b78c-96e79c87caeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:44.088839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178e38-3ec8-4570-b78c-96e79c87caeb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.089114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178e38-3ec8-4570-b78c-96e79c87caeb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.089380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178e38-3ec8-4570-b78c-96e79c87caeb None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.091410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02178e38-3ec8-4570-b78c-96e79c87caeb None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:44.093106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02178e38-3ec8-4570-b78c-96e79c87caeb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:44.096925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 192/400] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:43 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:44.099967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178e38-3ec8-4570-b78c-96e79c87caeb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:44.210403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178e38-3ec8-4570-b78c-96e79c87caeb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:44.214283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593d531-6c52-41fc-87f7-e3c16393fddf None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:44.225749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:44.250808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632b966-6a3d-4bcc-8dd2-64bde78fb314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:44.251437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632b966-6a3d-4bcc-8dd2-64bde78fb314 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.251711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632b966-6a3d-4bcc-8dd2-64bde78fb314 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.251978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632b966-6a3d-4bcc-8dd2-64bde78fb314 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.253107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632b966-6a3d-4bcc-8dd2-64bde78fb314 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:44.254537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632b966-6a3d-4bcc-8dd2-64bde78fb314 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:44.258386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 193/401] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:44 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:44.259827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632b966-6a3d-4bcc-8dd2-64bde78fb314 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:44.261154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64a3fb-9ca8-45a3-a58d-990f0af1dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:44.262724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64a3fb-9ca8-45a3-a58d-990f0af1dabe None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.263228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64a3fb-9ca8-45a3-a58d-990f0af1dabe None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.263697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64a3fb-9ca8-45a3-a58d-990f0af1dabe None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/groups/dce09959c6d845cb803c48caea281c9e/roles/043adf092a6b422e961a0edc97df0a66` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.267283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64a3fb-9ca8-45a3-a58d-990f0af1dabe None admin] RBAC: Authorizing `identity:create_grant(project_id=e164e07e8ca44deda27ca9b205c2a48a, group_id=dce09959c6d845cb803c48caea281c9e, role_id=043adf092a6b422e961a0edc97df0a66)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:44.268745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64a3fb-9ca8-45a3-a58d-990f0af1dabe None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:44.287615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 209/402] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 24 04:47:44 2022] PUT /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a/groups/dce09959c6d845cb803c48caea281c9e/roles/043adf092a6b422e961a0edc97df0a66 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:44.287911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64a3fb-9ca8-45a3-a58d-990f0af1dabe None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:44.359272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:44.389074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632b966-6a3d-4bcc-8dd2-64bde78fb314 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:44.435047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346e3b-0dbf-4150-9d0a-c591c6f4af29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:44.435731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346e3b-0dbf-4150-9d0a-c591c6f4af29 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.436009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346e3b-0dbf-4150-9d0a-c591c6f4af29 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.436276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346e3b-0dbf-4150-9d0a-c591c6f4af29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.450190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64a3fb-9ca8-45a3-a58d-990f0af1dabe None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:44.455850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346e3b-0dbf-4150-9d0a-c591c6f4af29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-53346e3b-0dbf-4150-9d0a-c591c6f4af29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:44.463016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:44.463999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:44.464842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:44.467147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 194/403] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:44.468693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedaee-db0b-4168-9e69-5520e9b41b92 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.469585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedaee-db0b-4168-9e69-5520e9b41b92 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.470040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedaee-db0b-4168-9e69-5520e9b41b92 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.472168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 195/404] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:44.477339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bedaee-db0b-4168-9e69-5520e9b41b92 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:44.494630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316039f7-86c7-4dab-aabb-03d44611ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:44.495333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316039f7-86c7-4dab-aabb-03d44611ba2a None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.495614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316039f7-86c7-4dab-aabb-03d44611ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.495906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316039f7-86c7-4dab-aabb-03d44611ba2a None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7/groups/dce09959c6d845cb803c48caea281c9e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.497822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316039f7-86c7-4dab-aabb-03d44611ba2a None admin] RBAC: Authorizing `identity:create_grant(project_id=4e3eb031806d4c758fdf3846558516d7, group_id=dce09959c6d845cb803c48caea281c9e, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:44.499558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316039f7-86c7-4dab-aabb-03d44611ba2a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:44.516749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 210/405] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 24 04:47:44 2022] PUT /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7/groups/dce09959c6d845cb803c48caea281c9e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:44.518354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559f36c-2140-47f3-a98a-f23b8937aad2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.519061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559f36c-2140-47f3-a98a-f23b8937aad2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.519339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559f36c-2140-47f3-a98a-f23b8937aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.539228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:44.546621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f559f36c-2140-47f3-a98a-f23b8937aad2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:44.549954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f559f36c-2140-47f3-a98a-f23b8937aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:44.644616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bedaee-db0b-4168-9e69-5520e9b41b92 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:44.695387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:44.697142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.697577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.698066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.699334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:44.699824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:44.701357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:44.712741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 196/406] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:44.720773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:44.738044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 211/407] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:44.837639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbef703-644a-43c1-9b50-6b5d7533da35 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:44.840152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:44.874662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec14b-9aa5-4fc5-80aa-65731d14f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:44.875306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec14b-9aa5-4fc5-80aa-65731d14f3ff None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:44.875577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec14b-9aa5-4fc5-80aa-65731d14f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:44.875843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec14b-9aa5-4fc5-80aa-65731d14f3ff None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:44.876941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec14b-9aa5-4fc5-80aa-65731d14f3ff None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:44.878353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec14b-9aa5-4fc5-80aa-65731d14f3ff None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:44.880301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 197/408] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:44 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:44.886672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559f36c-2140-47f3-a98a-f23b8937aad2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:44.943170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:45.034769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559f36c-2140-47f3-a98a-f23b8937aad2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:45.079234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4fc3e-211d-4faa-9675-4bbe5fd11337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:45.079866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4fc3e-211d-4faa-9675-4bbe5fd11337 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:45.080141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4fc3e-211d-4faa-9675-4bbe5fd11337 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:45.080403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4fc3e-211d-4faa-9675-4bbe5fd11337 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:45.081516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4fc3e-211d-4faa-9675-4bbe5fd11337 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:45.082960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4fc3e-211d-4faa-9675-4bbe5fd11337 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:45.084853 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 212/409] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:44 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:45.091407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec14b-9aa5-4fc5-80aa-65731d14f3ff None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:45.163945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4fc3e-211d-4faa-9675-4bbe5fd11337 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:45.214441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec14b-9aa5-4fc5-80aa-65731d14f3ff None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:45.277672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26429f5-9ca0-4ecd-b4b3-caba736d7303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:45.278341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26429f5-9ca0-4ecd-b4b3-caba736d7303 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:45.278607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26429f5-9ca0-4ecd-b4b3-caba736d7303 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:45.278936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26429f5-9ca0-4ecd-b4b3-caba736d7303 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7/groups/dce09959c6d845cb803c48caea281c9e/roles/043adf092a6b422e961a0edc97df0a66` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:45.283585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26429f5-9ca0-4ecd-b4b3-caba736d7303 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e3eb031806d4c758fdf3846558516d7, group_id=dce09959c6d845cb803c48caea281c9e, role_id=043adf092a6b422e961a0edc97df0a66)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:45.286743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26429f5-9ca0-4ecd-b4b3-caba736d7303 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:45.310581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 198/410] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 24 04:47:45 2022] PUT /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7/groups/dce09959c6d845cb803c48caea281c9e/roles/043adf092a6b422e961a0edc97df0a66 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 04:47:45.359907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:45.363852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4fc3e-211d-4faa-9675-4bbe5fd11337 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:45.425265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f74e3-e91c-4980-bf4a-60c7678ca7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:45.425917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f74e3-e91c-4980-bf4a-60c7678ca7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:45.426198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f74e3-e91c-4980-bf4a-60c7678ca7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:45.426471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f74e3-e91c-4980-bf4a-60c7678ca7a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:45.444819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f74e3-e91c-4980-bf4a-60c7678ca7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b30f74e3-e91c-4980-bf4a-60c7678ca7a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:45.450938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:45.452357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:45.453138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 213/411] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:45.457829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26429f5-9ca0-4ecd-b4b3-caba736d7303 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:45.508297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:45.588306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26429f5-9ca0-4ecd-b4b3-caba736d7303 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:45.624154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:45.624759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:45.625031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:45.625296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:45.625950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:45.626246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:45.627617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:45.637563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 199/412] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:45.644021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f74e3-e91c-4980-bf4a-60c7678ca7a8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:45.759978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f74e3-e91c-4980-bf4a-60c7678ca7a8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:45.796752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d69c8-71e6-4a4d-9185-f4713784795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:45.797376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d69c8-71e6-4a4d-9185-f4713784795a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:45.797648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d69c8-71e6-4a4d-9185-f4713784795a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:45.797959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d69c8-71e6-4a4d-9185-f4713784795a None admin] PATH_INFO: `/v3/groups/d71cd9c0d4e6404585f7e2c43a57aafb` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:45.799105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d69c8-71e6-4a4d-9185-f4713784795a None admin] RBAC: Authorizing `identity:get_group(group_id=d71cd9c0d4e6404585f7e2c43a57aafb)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:45.800593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d69c8-71e6-4a4d-9185-f4713784795a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:45.802358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 214/413] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:45 2022] GET /identity/v3/groups/d71cd9c0d4e6404585f7e2c43a57aafb => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:45.807975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:45.843326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f813d-9008-4899-b5e8-4a02161a2552 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:45.843608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f813d-9008-4899-b5e8-4a02161a2552 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:45.843786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f813d-9008-4899-b5e8-4a02161a2552 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:45.845383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 215/414] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:45.851568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70abf00-3999-4762-aaf7-d9c0007ccff0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:45.852055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70abf00-3999-4762-aaf7-d9c0007ccff0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:45.852343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70abf00-3999-4762-aaf7-d9c0007ccff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:45.877766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c70abf00-3999-4762-aaf7-d9c0007ccff0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:45.878984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c70abf00-3999-4762-aaf7-d9c0007ccff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:45.931552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:45.991104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:46.000215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 216/415] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:46.006432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdfeff-8780-4736-b5f7-58bda4bb3603 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:46.042742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4409c6-c524-4ae6-a128-a183b34f51c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:46.043548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4409c6-c524-4ae6-a128-a183b34f51c0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:46.043929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4409c6-c524-4ae6-a128-a183b34f51c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:46.044348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4409c6-c524-4ae6-a128-a183b34f51c0 None admin] PATH_INFO: `/v3/projects/8b234c6113f54a018ff39cafffcc9b40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:46.045556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4409c6-c524-4ae6-a128-a183b34f51c0 None admin] RBAC: Authorizing `identity:get_project(project_id=8b234c6113f54a018ff39cafffcc9b40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:46.047080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4409c6-c524-4ae6-a128-a183b34f51c0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:46.049163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 200/416] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:45 2022] GET /identity/v3/projects/8b234c6113f54a018ff39cafffcc9b40 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:46.055475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70abf00-3999-4762-aaf7-d9c0007ccff0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:46.194886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70abf00-3999-4762-aaf7-d9c0007ccff0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:46.260332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a245f51-2bc6-47f0-836c-79c22301bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:46.261393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a245f51-2bc6-47f0-836c-79c22301bd99 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:46.261899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a245f51-2bc6-47f0-836c-79c22301bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:46.262368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a245f51-2bc6-47f0-836c-79c22301bd99 None admin] PATH_INFO: `/v3/projects/8b234c6113f54a018ff39cafffcc9b40/groups/d71cd9c0d4e6404585f7e2c43a57aafb/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:46.264500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a245f51-2bc6-47f0-836c-79c22301bd99 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b234c6113f54a018ff39cafffcc9b40, group_id=d71cd9c0d4e6404585f7e2c43a57aafb, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:46.266148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a245f51-2bc6-47f0-836c-79c22301bd99 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:46.298254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 217/417] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 24 04:47:46 2022] PUT /identity/v3/projects/8b234c6113f54a018ff39cafffcc9b40/groups/d71cd9c0d4e6404585f7e2c43a57aafb/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:47:46.331948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4409c6-c524-4ae6-a128-a183b34f51c0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:46.475693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4409c6-c524-4ae6-a128-a183b34f51c0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:46.527575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86a84-78a9-415a-b5e7-2379370732be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:46.528631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86a84-78a9-415a-b5e7-2379370732be None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:46.529107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86a84-78a9-415a-b5e7-2379370732be None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:46.529572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86a84-78a9-415a-b5e7-2379370732be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:46.543598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e86a84-78a9-415a-b5e7-2379370732be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-91e86a84-78a9-415a-b5e7-2379370732be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:46.548870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:46.549725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:46.550528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:46.551598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 201/418] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:46.556376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a245f51-2bc6-47f0-836c-79c22301bd99 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:46.577793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:46.678690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a245f51-2bc6-47f0-836c-79c22301bd99 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:46.732284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3b006-1cf2-48e5-a834-b7db5297fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:46.732939 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b006-1cf2-48e5-a834-b7db5297fd24 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:46.733223 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b006-1cf2-48e5-a834-b7db5297fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:46.733496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b006-1cf2-48e5-a834-b7db5297fd24 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:46.734192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3b006-1cf2-48e5-a834-b7db5297fd24 None admin] RBAC: Adding query filter params (name=member) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:46.734476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3b006-1cf2-48e5-a834-b7db5297fd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:46.736111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3b006-1cf2-48e5-a834-b7db5297fd24 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:46.746262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 218/419] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:46.752602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86a84-78a9-415a-b5e7-2379370732be None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:46.785109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:46.843384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e90a-1728-4a0f-93fd-b29009989cff None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:46.844043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e90a-1728-4a0f-93fd-b29009989cff None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:46.844506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561e90a-1728-4a0f-93fd-b29009989cff None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:46.846287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 219/420] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:46.853216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b10bb-4add-40aa-9504-09acc6fe652e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:46.853756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b10bb-4add-40aa-9504-09acc6fe652e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:46.854240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b10bb-4add-40aa-9504-09acc6fe652e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:46.891769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-688b10bb-4add-40aa-9504-09acc6fe652e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:46.892988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-688b10bb-4add-40aa-9504-09acc6fe652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:46.899536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86a84-78a9-415a-b5e7-2379370732be None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:46.940253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0773a-7eb7-4c1e-8378-1a9cd46797e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:46.941238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0773a-7eb7-4c1e-8378-1a9cd46797e9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:46.942684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0773a-7eb7-4c1e-8378-1a9cd46797e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:46.943106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0773a-7eb7-4c1e-8378-1a9cd46797e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:47.042954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0773a-7eb7-4c1e-8378-1a9cd46797e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:47.045319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0773a-7eb7-4c1e-8378-1a9cd46797e9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:47.057641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 220/421] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:47.084520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:47.228956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 202/422] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:47.234341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b10bb-4add-40aa-9504-09acc6fe652e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:47.259465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:47.361748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0773a-7eb7-4c1e-8378-1a9cd46797e9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:47.391778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b10bb-4add-40aa-9504-09acc6fe652e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:47.439959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87864e-269c-4d07-bba7-53153f1f0564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:47.441460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87864e-269c-4d07-bba7-53153f1f0564 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:47.441745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87864e-269c-4d07-bba7-53153f1f0564 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:47.442021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87864e-269c-4d07-bba7-53153f1f0564 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:47.443180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87864e-269c-4d07-bba7-53153f1f0564 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:47.444615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87864e-269c-4d07-bba7-53153f1f0564 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:47.447196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 221/423] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:47 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:47.448868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a461c-777d-4728-9c27-3f49eba9f314 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:47.449150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a461c-777d-4728-9c27-3f49eba9f314 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:47.449427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a461c-777d-4728-9c27-3f49eba9f314 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:47.450774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 222/424] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:47.455821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a461c-777d-4728-9c27-3f49eba9f314 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:47.479612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0773a-7eb7-4c1e-8378-1a9cd46797e9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:47.510035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:47.524406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe2a26-7b19-4661-8bd8-0abff7522030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:47.525622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2a26-7b19-4661-8bd8-0abff7522030 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:47.525986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2a26-7b19-4661-8bd8-0abff7522030 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:47.526329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2a26-7b19-4661-8bd8-0abff7522030 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:47.538284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe2a26-7b19-4661-8bd8-0abff7522030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e5fe2a26-7b19-4661-8bd8-0abff7522030 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:47.544630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:47.545493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:47.546287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 203/425] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:47.547612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11d77-6371-4bc0-9d17-96bbb673da90 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:47.550772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11d77-6371-4bc0-9d17-96bbb673da90 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:47.550772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11d77-6371-4bc0-9d17-96bbb673da90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:47.560159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:47.570095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b3d11d77-6371-4bc0-9d17-96bbb673da90 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:47.571364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b3d11d77-6371-4bc0-9d17-96bbb673da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:47.587832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a461c-777d-4728-9c27-3f49eba9f314 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:47.628685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41945-c1b1-497b-86ba-d3ae11facfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:47.629371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41945-c1b1-497b-86ba-d3ae11facfbd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:47.629738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41945-c1b1-497b-86ba-d3ae11facfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:47.630114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41945-c1b1-497b-86ba-d3ae11facfbd None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:47.631368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d41945-c1b1-497b-86ba-d3ae11facfbd None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:47.633139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d41945-c1b1-497b-86ba-d3ae11facfbd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:47.639845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 223/426] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:47 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:47.640703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41945-c1b1-497b-86ba-d3ae11facfbd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:47.649920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 204/427] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:47.656027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11d77-6371-4bc0-9d17-96bbb673da90 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:47.795926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41945-c1b1-497b-86ba-d3ae11facfbd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:47.844627 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:47.845245 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:47.845525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:47.845796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:47.850187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:47.850502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:47.852456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:47.869292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 224/428] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:47.874796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11d77-6371-4bc0-9d17-96bbb673da90 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:47.884964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:47.896718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:47.898842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:47.956415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc306-930d-435c-9d31-540d92175021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:47.957035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc306-930d-435c-9d31-540d92175021 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:47.957314 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc306-930d-435c-9d31-540d92175021 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:47.957584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc306-930d-435c-9d31-540d92175021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:47.958312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc306-930d-435c-9d31-540d92175021 None admin] RBAC: Adding query filter params (group.id=dce09959c6d845cb803c48caea281c9e, role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:47.958621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc306-930d-435c-9d31-540d92175021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:47.960085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc306-930d-435c-9d31-540d92175021 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:47.968727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 205/429] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:47 2022] GET /identity/v3/role_assignments?group.id=dce09959c6d845cb803c48caea281c9e&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 611 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:47.969720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc306-930d-435c-9d31-540d92175021 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:48.015423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007068ba-81de-4064-9bd7-a364ed70dfc3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:48.059250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b13b5-61d7-4504-97e2-b931419b7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:48.060578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b13b5-61d7-4504-97e2-b931419b7a33 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.061010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b13b5-61d7-4504-97e2-b931419b7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.061760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b13b5-61d7-4504-97e2-b931419b7a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.154780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b13b5-61d7-4504-97e2-b931419b7a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:48.157399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b13b5-61d7-4504-97e2-b931419b7a33 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:48.170720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:48.235278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc306-930d-435c-9d31-540d92175021 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:48.279387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 225/430] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 04:47:48.280381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee94cef-69fa-4d67-af7a-018ed7cfa16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:48.281028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee94cef-69fa-4d67-af7a-018ed7cfa16c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.281150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65313-2259-425c-a769-2fc80e0ac82e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.281306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee94cef-69fa-4d67-af7a-018ed7cfa16c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.281575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee94cef-69fa-4d67-af7a-018ed7cfa16c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.281842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65313-2259-425c-a769-2fc80e0ac82e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.282235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65313-2259-425c-a769-2fc80e0ac82e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.284034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 226/431] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:48.285334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65313-2259-425c-a769-2fc80e0ac82e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:48.296206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee94cef-69fa-4d67-af7a-018ed7cfa16c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-cee94cef-69fa-4d67-af7a-018ed7cfa16c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:48.301745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:48.302650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 04:47:48.303516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:48.306634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 206/432] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:48.308079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550dd48-4051-4f5f-9d11-c02cdcf88bd1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.308519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550dd48-4051-4f5f-9d11-c02cdcf88bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.308976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550dd48-4051-4f5f-9d11-c02cdcf88bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.328726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d550dd48-4051-4f5f-9d11-c02cdcf88bd1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:48.329933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d550dd48-4051-4f5f-9d11-c02cdcf88bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:48.366222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:48.412963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 207/433] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:48.415430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550dd48-4051-4f5f-9d11-c02cdcf88bd1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:48.417561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65313-2259-425c-a769-2fc80e0ac82e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:48.427844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:48.462828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8474-4730-4481-ba0a-6b847b0d4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:48.464314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8474-4730-4481-ba0a-6b847b0d4b77 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.464737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8474-4730-4481-ba0a-6b847b0d4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.465181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8474-4730-4481-ba0a-6b847b0d4b77 None admin] PATH_INFO: `/v3/projects/e164e07e8ca44deda27ca9b205c2a48a` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.467031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe8474-4730-4481-ba0a-6b847b0d4b77 None admin] RBAC: Authorizing `identity:get_project(project_id=e164e07e8ca44deda27ca9b205c2a48a)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:48.469330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe8474-4730-4481-ba0a-6b847b0d4b77 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:48.472434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 227/434] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:48 2022] GET /identity/v3/projects/e164e07e8ca44deda27ca9b205c2a48a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:48.477564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8474-4730-4481-ba0a-6b847b0d4b77 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:48.533812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550dd48-4051-4f5f-9d11-c02cdcf88bd1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:48.575074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:48.575911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.576330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.576766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.577567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:48.578010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:48.579674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:48.589104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 208/435] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:47:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:48.594875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:48.612861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8474-4730-4481-ba0a-6b847b0d4b77 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:48.631080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:48.665467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02ba31-ce3d-496a-b42b-dfd8f5b4c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:48.666270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02ba31-ce3d-496a-b42b-dfd8f5b4c669 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.666778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02ba31-ce3d-496a-b42b-dfd8f5b4c669 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.667236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02ba31-ce3d-496a-b42b-dfd8f5b4c669 None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.668727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02ba31-ce3d-496a-b42b-dfd8f5b4c669 None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:48.670350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02ba31-ce3d-496a-b42b-dfd8f5b4c669 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:48.672616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 228/436] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:48 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:48.678434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02ba31-ce3d-496a-b42b-dfd8f5b4c669 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:48.712265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b5491-e582-4704-9c93-aafd41e03037 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:48.743137 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:48.751039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578fa22-72bd-4106-9df6-dfb699212455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:48.751673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578fa22-72bd-4106-9df6-dfb699212455 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.751948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578fa22-72bd-4106-9df6-dfb699212455 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.752238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578fa22-72bd-4106-9df6-dfb699212455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.800081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02ba31-ce3d-496a-b42b-dfd8f5b4c669 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:48.830620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578fa22-72bd-4106-9df6-dfb699212455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:48.832083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578fa22-72bd-4106-9df6-dfb699212455 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:48.835866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:48.836452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:48.836728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:48.836996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:48.837720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] RBAC: Adding query filter params (group.id=dce09959c6d845cb803c48caea281c9e, role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=e164e07e8ca44deda27ca9b205c2a48a) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:48.838023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:48.839460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:48.845653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 229/437] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:48 2022] GET /identity/v3/role_assignments?group.id=dce09959c6d845cb803c48caea281c9e&scope.project.id=e164e07e8ca44deda27ca9b205c2a48a&role.id=043adf092a6b422e961a0edc97df0a66 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:48.846513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:48.865662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:48.961052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 209/438] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 04:47:48.966488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578fa22-72bd-4106-9df6-dfb699212455 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:48.997386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2fe5-19fd-4be6-9fe8-d5b5cdbffd72 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.008398 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:49.034292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa206e-d818-488f-bc5f-a898ade980f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.034954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa206e-d818-488f-bc5f-a898ade980f9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.035233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa206e-d818-488f-bc5f-a898ade980f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.035498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa206e-d818-488f-bc5f-a898ade980f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.045873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa206e-d818-488f-bc5f-a898ade980f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-3eaa206e-d818-488f-bc5f-a898ade980f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:49.051168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:49.052108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 230/439] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:49.055611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a6ec1-05ef-4242-aad3-7cee8ba91ec4 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.056548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a6ec1-05ef-4242-aad3-7cee8ba91ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.056548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a6ec1-05ef-4242-aad3-7cee8ba91ec4 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.056548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 231/440] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:49.058481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a6ec1-05ef-4242-aad3-7cee8ba91ec4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.087276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578fa22-72bd-4106-9df6-dfb699212455 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.121692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:49.133234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97191713-61b2-48c5-9eb4-8be773d27e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.133868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97191713-61b2-48c5-9eb4-8be773d27e62 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.134139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97191713-61b2-48c5-9eb4-8be773d27e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.134405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97191713-61b2-48c5-9eb4-8be773d27e62 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.135646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97191713-61b2-48c5-9eb4-8be773d27e62 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:49.137105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97191713-61b2-48c5-9eb4-8be773d27e62 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:49.138729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 210/441] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:48 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:49.140023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54871-12a8-433b-b873-dd0df2a7e55c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.140304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54871-12a8-433b-b873-dd0df2a7e55c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.140569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54871-12a8-433b-b873-dd0df2a7e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.160950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d6c54871-12a8-433b-b873-dd0df2a7e55c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:49.162113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d6c54871-12a8-433b-b873-dd0df2a7e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:49.185087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a6ec1-05ef-4242-aad3-7cee8ba91ec4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.227455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.228185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.228495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.228765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.229428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:49.229728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:49.231126 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:49.243022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 232/442] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:49.245119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.246458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 211/443] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:49.251934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54871-12a8-433b-b873-dd0df2a7e55c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.281397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:49.356377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ecc65-6d10-4c78-aa61-1a17b67b21b0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.362372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54871-12a8-433b-b873-dd0df2a7e55c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.388471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:49.394928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e514-470c-4d92-9545-ff7ef6a275c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.395786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e514-470c-4d92-9545-ff7ef6a275c3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.396232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e514-470c-4d92-9545-ff7ef6a275c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.396665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e514-470c-4d92-9545-ff7ef6a275c3 None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.397543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449bee5-ee72-4652-b374-17da09fa1d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.398158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449bee5-ee72-4652-b374-17da09fa1d78 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.398272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077e514-470c-4d92-9545-ff7ef6a275c3 None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:49.398432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449bee5-ee72-4652-b374-17da09fa1d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.398701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449bee5-ee72-4652-b374-17da09fa1d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.400237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077e514-470c-4d92-9545-ff7ef6a275c3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:49.402785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 233/444] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:49.407580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e514-470c-4d92-9545-ff7ef6a275c3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.468938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449bee5-ee72-4652-b374-17da09fa1d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:49.470368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449bee5-ee72-4652-b374-17da09fa1d78 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:49.505410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:49.510123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e514-470c-4d92-9545-ff7ef6a275c3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.546675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.547291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.547564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.547830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.548541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] RBAC: Adding query filter params (group.id=dce09959c6d845cb803c48caea281c9e, role.id=b916ec3f3c9e4a4980a4dc11ee70ee19, scope.project.id=4e3eb031806d4c758fdf3846558516d7) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:49.548845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:49.550267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:49.556561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 234/445] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/role_assignments?group.id=dce09959c6d845cb803c48caea281c9e&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:49.557334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.583265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 212/446] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:49.584490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449bee5-ee72-4652-b374-17da09fa1d78 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.616430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:49.669298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07425-15bf-4693-a8b1-27b194304228 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.709595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449bee5-ee72-4652-b374-17da09fa1d78 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.711101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e7c28-e367-40fa-934b-689924605624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.711766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e7c28-e367-40fa-934b-689924605624 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.712228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e7c28-e367-40fa-934b-689924605624 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.712497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e7c28-e367-40fa-934b-689924605624 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.727482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e7c28-e367-40fa-934b-689924605624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-7b1e7c28-e367-40fa-934b-689924605624 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:49.733357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:49.734233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:49.735086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 235/447] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:49.741475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e7c28-e367-40fa-934b-689924605624 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.749602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754078d8-cf67-47bb-8af3-4e3e02a9f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.750235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754078d8-cf67-47bb-8af3-4e3e02a9f750 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.750509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754078d8-cf67-47bb-8af3-4e3e02a9f750 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.750798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754078d8-cf67-47bb-8af3-4e3e02a9f750 None admin] PATH_INFO: `/v3/projects/4e3eb031806d4c758fdf3846558516d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.751930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754078d8-cf67-47bb-8af3-4e3e02a9f750 None admin] RBAC: Authorizing `identity:get_project(project_id=4e3eb031806d4c758fdf3846558516d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:49.753338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754078d8-cf67-47bb-8af3-4e3e02a9f750 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:49.755231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 213/448] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/projects/4e3eb031806d4c758fdf3846558516d7 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:49.760883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754078d8-cf67-47bb-8af3-4e3e02a9f750 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.769093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:49.862218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e7c28-e367-40fa-934b-689924605624 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.876499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:49.883791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754078d8-cf67-47bb-8af3-4e3e02a9f750 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:49.904302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.904917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.905193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.905464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.906128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:49.906899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:49.908275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:49.918548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 236/449] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:49.924807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:49.924932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385266d-a50d-43ad-84e8-212d379e4199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:49.925445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385266d-a50d-43ad-84e8-212d379e4199 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:49.925720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385266d-a50d-43ad-84e8-212d379e4199 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:49.925979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385266d-a50d-43ad-84e8-212d379e4199 None admin] PATH_INFO: `/v3/groups/dce09959c6d845cb803c48caea281c9e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:49.927315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385266d-a50d-43ad-84e8-212d379e4199 None admin] RBAC: Authorizing `identity:get_group(group_id=dce09959c6d845cb803c48caea281c9e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:49.928762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385266d-a50d-43ad-84e8-212d379e4199 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:49.931237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 214/450] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/groups/dce09959c6d845cb803c48caea281c9e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:49.936718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385266d-a50d-43ad-84e8-212d379e4199 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:50.015984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:50.031383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b11fb6-a762-412f-9406-0b1d69181ef2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:50.038564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385266d-a50d-43ad-84e8-212d379e4199 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:50.064908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4688-fa8b-4390-9464-14d75224530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:50.065526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4688-fa8b-4390-9464-14d75224530b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:50.065800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4688-fa8b-4390-9464-14d75224530b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:50.066067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4688-fa8b-4390-9464-14d75224530b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:50.072018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:50.072608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:50.072880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:50.073147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:50.073861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] RBAC: Adding query filter params (group.id=dce09959c6d845cb803c48caea281c9e, role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=4e3eb031806d4c758fdf3846558516d7) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:50.074221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:50.075709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:50.081230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 215/451] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/role_assignments?group.id=dce09959c6d845cb803c48caea281c9e&scope.project.id=4e3eb031806d4c758fdf3846558516d7&role.id=043adf092a6b422e961a0edc97df0a66 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:50.135271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4688-fa8b-4390-9464-14d75224530b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:50.136748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4688-fa8b-4390-9464-14d75224530b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:50.222009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:50.239819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 237/452] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 04:47:50.246558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:50.277425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:50.353374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86c1f-6174-4e7d-bd61-26c472f49235 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:50.386146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da58c4b-8d17-4359-9369-c3541648c4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:50.386740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58c4b-8d17-4359-9369-c3541648c4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:50.387044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58c4b-8d17-4359-9369-c3541648c4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:50.387307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58c4b-8d17-4359-9369-c3541648c4d8 None admin] PATH_INFO: `/v3/projects/8b234c6113f54a018ff39cafffcc9b40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:50.388415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da58c4b-8d17-4359-9369-c3541648c4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=8b234c6113f54a018ff39cafffcc9b40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:50.389820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da58c4b-8d17-4359-9369-c3541648c4d8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:50.391444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 216/453] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:47:50 2022] GET /identity/v3/projects/8b234c6113f54a018ff39cafffcc9b40 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:50.397081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4688-fa8b-4390-9464-14d75224530b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:50.502774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4688-fa8b-4390-9464-14d75224530b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:50.536173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04d2d2-3c21-465f-8723-a00afd47ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:50.536716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04d2d2-3c21-465f-8723-a00afd47ce72 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:50.536987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04d2d2-3c21-465f-8723-a00afd47ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:50.537252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04d2d2-3c21-465f-8723-a00afd47ce72 None admin] PATH_INFO: `/v3/groups/d71cd9c0d4e6404585f7e2c43a57aafb` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:50.538318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04d2d2-3c21-465f-8723-a00afd47ce72 None admin] RBAC: Authorizing `identity:get_group(group_id=d71cd9c0d4e6404585f7e2c43a57aafb)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:50.540794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04d2d2-3c21-465f-8723-a00afd47ce72 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:50.542321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 238/454] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 24 04:47:50 2022] GET /identity/v3/groups/d71cd9c0d4e6404585f7e2c43a57aafb => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:50.548147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da58c4b-8d17-4359-9369-c3541648c4d8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:50.637922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:50.644633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da58c4b-8d17-4359-9369-c3541648c4d8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:50.678170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad33e83-ab3c-4f6a-9f2f-7a7b5c695dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:50.678778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33e83-ab3c-4f6a-9f2f-7a7b5c695dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:50.679070 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33e83-ab3c-4f6a-9f2f-7a7b5c695dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:50.679362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33e83-ab3c-4f6a-9f2f-7a7b5c695dc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:50.680079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33e83-ab3c-4f6a-9f2f-7a7b5c695dc8 None admin] RBAC: Adding query filter params (group.id=d71cd9c0d4e6404585f7e2c43a57aafb, role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=8b234c6113f54a018ff39cafffcc9b40) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:50.680392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33e83-ab3c-4f6a-9f2f-7a7b5c695dc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:50.681790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33e83-ab3c-4f6a-9f2f-7a7b5c695dc8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:50.687290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 217/455] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 24 04:47:50 2022] GET /identity/v3/role_assignments?group.id=d71cd9c0d4e6404585f7e2c43a57aafb&scope.project.id=8b234c6113f54a018ff39cafffcc9b40&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:53.359467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8215-661d-4f8f-bad6-8de46b7ee35d None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:53.360475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8215-661d-4f8f-bad6-8de46b7ee35d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:53.360988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8215-661d-4f8f-bad6-8de46b7ee35d None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:53.362490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 239/456] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:53.368701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3d94-eab5-42cf-8898-33d0e101db1a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:53.369609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3d94-eab5-42cf-8898-33d0e101db1a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:53.370075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3d94-eab5-42cf-8898-33d0e101db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:53.374422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021a7d-2fab-44c8-b1c3-3ace44251ea2 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:53.374965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021a7d-2fab-44c8-b1c3-3ace44251ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:53.375425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021a7d-2fab-44c8-b1c3-3ace44251ea2 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:53.379171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 240/457] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:53.381824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af63b4-cb2b-411b-b8b7-878aef5111fa None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:53.382500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af63b4-cb2b-411b-b8b7-878aef5111fa None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:53.383009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af63b4-cb2b-411b-b8b7-878aef5111fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:53.396380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-715c3d94-eab5-42cf-8898-33d0e101db1a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:53.397555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-715c3d94-eab5-42cf-8898-33d0e101db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:53.411346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-68af63b4-cb2b-411b-b8b7-878aef5111fa None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:53.412640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-68af63b4-cb2b-411b-b8b7-878aef5111fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:53.486260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 218/458] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:53.507921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:53.536168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 241/459] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:53.815472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c3d94-eab5-42cf-8898-33d0e101db1a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:53.838488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0efe1f-f77c-42bc-9eb6-a64ccfb419ed None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:53.839160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0efe1f-f77c-42bc-9eb6-a64ccfb419ed None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:53.839640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0efe1f-f77c-42bc-9eb6-a64ccfb419ed None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:53.841417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 242/460] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:53.847250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07672ff-33c7-4335-bca7-a5e851584ce5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:53.848236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07672ff-33c7-4335-bca7-a5e851584ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:53.848879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07672ff-33c7-4335-bca7-a5e851584ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:53.887734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e07672ff-33c7-4335-bca7-a5e851584ce5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:53.889262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e07672ff-33c7-4335-bca7-a5e851584ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:53.915964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:53.929133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c3d94-eab5-42cf-8898-33d0e101db1a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:53.969232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:53.970669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:53.970992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:53.971268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:53.983869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:53.985308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:47:54.002857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:54.003901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:47:54.004748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:47:54.004748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:54.004748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:54.005479 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 243/461] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:54.014976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07672ff-33c7-4335-bca7-a5e851584ce5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:54.015103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 219/462] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:54.020677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:54.129913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3d9a-2929-4e2d-905d-daba4da89b53 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:54.171520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:54.172046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.172315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.172577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.173214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:54.173511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:54.174872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:54.197175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:54.202824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 220/463] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:54.210249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:54.245778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07672ff-33c7-4335-bca7-a5e851584ce5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:54.265380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:54.310010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:54.311162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.311638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.312132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.325798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:54.328186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:54.335034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18f206-a7f4-41a9-ad3d-65f518833bb0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:47:54.357540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:54.358503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:47:54.359402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:47:54.359402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:54.359402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:54.361587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 244/464] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:54.362576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:54.384732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa95776-e906-48c6-8775-868109e5b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:54.385453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95776-e906-48c6-8775-868109e5b816 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.385618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95776-e906-48c6-8775-868109e5b816 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.385870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95776-e906-48c6-8775-868109e5b816 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.386514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa95776-e906-48c6-8775-868109e5b816 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:54.388696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa95776-e906-48c6-8775-868109e5b816 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:54.416206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 221/465] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:54 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:47:54.417094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa95776-e906-48c6-8775-868109e5b816 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:54.484337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:54.521901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b7b92-9408-42bd-a94f-e1059a4e1f52 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:54.551449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa95776-e906-48c6-8775-868109e5b816 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:54.561318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ccecc-f1fb-495a-b778-6701f2411733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:54.561971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ccecc-f1fb-495a-b778-6701f2411733 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.562251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ccecc-f1fb-495a-b778-6701f2411733 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.562525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ccecc-f1fb-495a-b778-6701f2411733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.575882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ccecc-f1fb-495a-b778-6701f2411733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:54.577562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ccecc-f1fb-495a-b778-6701f2411733 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-4b7ccecc-f1fb-495a-b778-6701f2411733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:47:54.595681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:54.596687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:47:54.597541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:47:54.597541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:54.597541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:54.598633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd698af-33d6-48c1-b18e-1dd264a12e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:54.599637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd698af-33d6-48c1-b18e-1dd264a12e3e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.600119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd698af-33d6-48c1-b18e-1dd264a12e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.600598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd698af-33d6-48c1-b18e-1dd264a12e3e None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.601722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd698af-33d6-48c1-b18e-1dd264a12e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:54.602022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 245/466] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:54.602653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd698af-33d6-48c1-b18e-1dd264a12e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:54.603462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6789b95-76db-4435-95b6-a38f0a6f8837 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.603749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6789b95-76db-4435-95b6-a38f0a6f8837 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.604024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6789b95-76db-4435-95b6-a38f0a6f8837 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.605163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd698af-33d6-48c1-b18e-1dd264a12e3e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:54.605667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 246/467] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:54.606446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6789b95-76db-4435-95b6-a38f0a6f8837 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:54.630619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 222/468] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:54.630619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86e24-20a5-48f3-a298-fea4f8d4f569 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.630619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86e24-20a5-48f3-a298-fea4f8d4f569 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.630619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86e24-20a5-48f3-a298-fea4f8d4f569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.634143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:54.657705 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c5a86e24-20a5-48f3-a298-fea4f8d4f569 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:54.658351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5a86e24-20a5-48f3-a298-fea4f8d4f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:54.746091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6789b95-76db-4435-95b6-a38f0a6f8837 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:54.750986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 223/469] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:54.752083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86e24-20a5-48f3-a298-fea4f8d4f569 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:54.782542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:54.783179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.783458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.783730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.784375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:54.784681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:54.786169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:54.804072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:54.806563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 247/470] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:54.812263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:54.860549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86e24-20a5-48f3-a298-fea4f8d4f569 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:54.905922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849a59d-f884-4c57-8315-65584df8e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:54.906522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849a59d-f884-4c57-8315-65584df8e2b1 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.906824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849a59d-f884-4c57-8315-65584df8e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.907099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849a59d-f884-4c57-8315-65584df8e2b1 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.907748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849a59d-f884-4c57-8315-65584df8e2b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:54.909870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849a59d-f884-4c57-8315-65584df8e2b1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:54.917031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:54.942994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 224/471] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:54 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:47:54.942994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42d516-bef8-4899-990a-b54c98d52afe None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.942994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42d516-bef8-4899-990a-b54c98d52afe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.942994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42d516-bef8-4899-990a-b54c98d52afe None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.942994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 225/472] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:54.947965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e85a-659a-4b4b-9f6e-e55a230e64b1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:54.948280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e85a-659a-4b4b-9f6e-e55a230e64b1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:54.948522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e85a-659a-4b4b-9f6e-e55a230e64b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:54.972079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08032cd-b7cd-4f41-b39a-6e23de3f0bfc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:54.984691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dcd8e85a-659a-4b4b-9f6e-e55a230e64b1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:54.985916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dcd8e85a-659a-4b4b-9f6e-e55a230e64b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:55.038098 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46dc28-68ce-4336-92f3-8a01df8ae5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:55.039911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46dc28-68ce-4336-92f3-8a01df8ae5c9 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:55.040195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46dc28-68ce-4336-92f3-8a01df8ae5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:55.040464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46dc28-68ce-4336-92f3-8a01df8ae5c9 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:55.041149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46dc28-68ce-4336-92f3-8a01df8ae5c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:55.043077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46dc28-68ce-4336-92f3-8a01df8ae5c9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:55.077268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 248/473] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:54 2022] POST /identity/v3/users => generated 248 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:47:55.078145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46dc28-68ce-4336-92f3-8a01df8ae5c9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:55.099404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 226/474] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:55.234355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46dc28-68ce-4336-92f3-8a01df8ae5c9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:55.267960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:55.274618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:55.276538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:55.276860 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:55.277144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:55.290718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:55.292179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:47:55.308334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:55.309306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:47:55.310141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:47:55.310141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:55.310141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:55.310141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 249/475] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:55.315820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8e85a-659a-4b4b-9f6e-e55a230e64b1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:55.350604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:55.406989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:55.443952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8e85a-659a-4b4b-9f6e-e55a230e64b1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:55.488680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:55.489294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:55.489564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:55.490084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:55.490477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:55.490775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:55.492381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:55.510915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 227/476] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:55.512818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:55.546066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a28b1-95d5-4692-a20b-2cf5e0373163 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:55.581688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:55.582289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:55.582564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:55.582866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:55.583547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:55.584919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:55.600393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.sql.core [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 04:47:55.600393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 24 04:47:55.600393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [parameters: {'id': 'e8fc382654ab469eb913d1ef7a2ffddb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 24 04:47:55.600393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Sep 24 04:47:55.625913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return ref.to_dict() Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 04:47:55.626904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application yield resource Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise self.value Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application session.commit() Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 04:47:55.627845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.flush() Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application compat.raise_( Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 04:47:55.628719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 04:47:55.629600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 04:47:55.631767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [parameters: {'id': 'e8fc382654ab469eb913d1ef7a2ffddb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:55.633831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 24 04:47:55.636042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:55.638019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 250/477] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 24 04:47:55 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:55.641287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:55.642462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:55.654894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50852cdd-c2f3-4f0e-9b80-83f5d3754b61 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:55.717313 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecabca-2974-4ee3-b1f7-b473c5796e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:55.718795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecabca-2974-4ee3-b1f7-b473c5796e5e None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:55.719147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecabca-2974-4ee3-b1f7-b473c5796e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:55.720130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecabca-2974-4ee3-b1f7-b473c5796e5e None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:55.722266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecabca-2974-4ee3-b1f7-b473c5796e5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:55.732550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecabca-2974-4ee3-b1f7-b473c5796e5e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:55.756507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:55.779608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 228/478] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:47:55 2022] POST /identity/v3/users => generated 249 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:47:55.837760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bc6a0-fb0c-4ebc-b7f1-5e973173d493 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:55.885017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7e964-fbff-4761-b494-d08dd2d6a959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:55.885767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7e964-fbff-4761-b494-d08dd2d6a959 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:55.886152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7e964-fbff-4761-b494-d08dd2d6a959 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:55.886548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7e964-fbff-4761-b494-d08dd2d6a959 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:55.899638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7e964-fbff-4761-b494-d08dd2d6a959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-19c7e964-fbff-4761-b494-d08dd2d6a959 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:55.904737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:55.905849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 04:47:55.906885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:55.912645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 251/479] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:47:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:55.914734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecabca-2974-4ee3-b1f7-b473c5796e5e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:56.041093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecabca-2974-4ee3-b1f7-b473c5796e5e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:56.076620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa9873-162e-4b73-9ba0-8e70aee3b4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:56.077322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa9873-162e-4b73-9ba0-8e70aee3b4bd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:56.077671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa9873-162e-4b73-9ba0-8e70aee3b4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:56.078007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa9873-162e-4b73-9ba0-8e70aee3b4bd None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:56.078740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa9873-162e-4b73-9ba0-8e70aee3b4bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:56.079172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa9873-162e-4b73-9ba0-8e70aee3b4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:56.080694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa9873-162e-4b73-9ba0-8e70aee3b4bd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:56.094981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 229/480] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:47:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:57.181650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4668-5707-4c6b-86cb-4bb2a4c6ec28 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:57.182177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4668-5707-4c6b-86cb-4bb2a4c6ec28 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:57.182177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4668-5707-4c6b-86cb-4bb2a4c6ec28 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:57.183968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 252/481] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:57.189358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d553712-61e9-4d6b-8e90-0e309cdf55cf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:57.189862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d553712-61e9-4d6b-8e90-0e309cdf55cf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:57.190015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d553712-61e9-4d6b-8e90-0e309cdf55cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:57.216478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1d553712-61e9-4d6b-8e90-0e309cdf55cf None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:57.217714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1d553712-61e9-4d6b-8e90-0e309cdf55cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:57.220958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:57.305233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 230/482] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:57.659201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f4668-5707-4c6b-86cb-4bb2a4c6ec28 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:57.744825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f221-5540-4191-98f1-47d9e0454898 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:57.745151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f221-5540-4191-98f1-47d9e0454898 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:57.745371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f221-5540-4191-98f1-47d9e0454898 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:57.746964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 231/483] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:57.753184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002393f7-16fd-4eda-ae75-067fe0a11644 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:57.753459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002393f7-16fd-4eda-ae75-067fe0a11644 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:57.753728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002393f7-16fd-4eda-ae75-067fe0a11644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:57.782293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-002393f7-16fd-4eda-ae75-067fe0a11644 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:57.784610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-002393f7-16fd-4eda-ae75-067fe0a11644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:57.799868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f4668-5707-4c6b-86cb-4bb2a4c6ec28 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:57.823114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:57.860443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e0839-2a56-430e-b9e3-35688656364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:57.861075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e0839-2a56-430e-b9e3-35688656364d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:57.861350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e0839-2a56-430e-b9e3-35688656364d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:57.861614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e0839-2a56-430e-b9e3-35688656364d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:57.883550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e0839-2a56-430e-b9e3-35688656364d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-3f1e0839-2a56-430e-b9e3-35688656364d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:57.889608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:57.890551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:57.891409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 253/484] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:57.898267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e0839-2a56-430e-b9e3-35688656364d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:57.929967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 232/485] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:47:58.018734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89593-dc5f-4d98-9995-c393440bcd85 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.019176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89593-dc5f-4d98-9995-c393440bcd85 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.019517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89593-dc5f-4d98-9995-c393440bcd85 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.022188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 233/486] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:47:58.032680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1f83-a852-451e-af8d-ba6b6df1b635 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.032959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1f83-a852-451e-af8d-ba6b6df1b635 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.033230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1f83-a852-451e-af8d-ba6b6df1b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.044607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e0839-2a56-430e-b9e3-35688656364d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:58.067772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a70b1f83-a852-451e-af8d-ba6b6df1b635 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:58.068963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a70b1f83-a852-451e-af8d-ba6b6df1b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:58.108474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:58.109080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.109355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.109625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.110298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:58.110606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:58.111994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:58.136032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 254/487] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:58.141642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:58.172488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:58.186647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 234/488] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:58.199624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:58.289664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d15b86-31f6-4a0a-9e6b-8edb6b8126c5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:58.324687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:58.325321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.325601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.325876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.336062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:58.337509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:58.348920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1f83-a852-451e-af8d-ba6b6df1b635 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:47:58.353461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:58.354419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:47:58.355285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:47:58.355285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:58.355285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:58.355285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 255/489] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:58.360025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:58.467272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:58.477996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bbfb2-74e1-412b-83d3-fd4eab9ce283 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:58.515963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:58.516674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.516958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.517228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.518053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:58.518363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:58.519857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:58.537498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1f83-a852-451e-af8d-ba6b6df1b635 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:58.542282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 256/490] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:47:58.547363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:58.579415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af7eed-e379-431e-841c-2cf0b46dc660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:58.580076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7eed-e379-431e-841c-2cf0b46dc660 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.580352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7eed-e379-431e-841c-2cf0b46dc660 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.580621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7eed-e379-431e-841c-2cf0b46dc660 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.594044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af7eed-e379-431e-841c-2cf0b46dc660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f3af7eed-e379-431e-841c-2cf0b46dc660 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:58.600077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:58.601001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:58.602198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 235/491] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:47:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:58.607974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af7eed-e379-431e-841c-2cf0b46dc660 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:58.676842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:58.678475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0ea9-c37d-46ef-b498-0a73f7ca89fa None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:58.715444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:58.716427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.716893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.717403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.720709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af7eed-e379-431e-841c-2cf0b46dc660 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:58.725405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:58.727988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:47:58.740996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:58.742279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 04:47:58.743593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:58.745695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 257/492] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:47:58.746483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:58.749323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:58.762122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8781d4a-a859-4dde-80f7-119fa4fec214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:58.762770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8781d4a-a859-4dde-80f7-119fa4fec214 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.763050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8781d4a-a859-4dde-80f7-119fa4fec214 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.763316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8781d4a-a859-4dde-80f7-119fa4fec214 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.774511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8781d4a-a859-4dde-80f7-119fa4fec214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b8781d4a-a859-4dde-80f7-119fa4fec214 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:58.779388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:58.780454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:58.781604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 236/493] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:47:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:58.782264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242481-1d12-404a-b670-df24f26bd8ba None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.782264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242481-1d12-404a-b670-df24f26bd8ba None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.782481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242481-1d12-404a-b670-df24f26bd8ba None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.784345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 237/494] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:58.788033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab242481-1d12-404a-b670-df24f26bd8ba None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:58.863774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbefc42-411f-4608-a8c1-7adcb4d0628c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:58.900243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:58.900841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.901118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.901378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.902040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:58.902341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:58.903820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:58.908893 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab242481-1d12-404a-b670-df24f26bd8ba None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:58.911822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 258/495] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:47:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:58.912807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:58.936533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:58.952572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd4661-3fd9-4f6c-86d1-fac1ca9930ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:58.953173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4661-3fd9-4f6c-86d1-fac1ca9930ef None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.953449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4661-3fd9-4f6c-86d1-fac1ca9930ef None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.953718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd4661-3fd9-4f6c-86d1-fac1ca9930ef None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:58.954441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd4661-3fd9-4f6c-86d1-fac1ca9930ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:58.954744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd4661-3fd9-4f6c-86d1-fac1ca9930ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:58.956334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd4661-3fd9-4f6c-86d1-fac1ca9930ef None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:58.978282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:58.993251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 238/496] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 24 04:47:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:58.994548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461c4c-b27e-42a2-8929-8d76b5b135d8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:58.994864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461c4c-b27e-42a2-8929-8d76b5b135d8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:58.995139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461c4c-b27e-42a2-8929-8d76b5b135d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.013460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-43461c4c-b27e-42a2-8929-8d76b5b135d8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:59.014644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-43461c4c-b27e-42a2-8929-8d76b5b135d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:59.016355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b47ec-a4a9-4fed-86b1-d5d8afcf7e73 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.050151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.051000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.051278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.051546 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.052202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:59.052503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.053856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.061547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 259/497] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:47:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:59.062335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.083079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 239/498] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:59.084300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5c8b-64d3-4646-96a6-7ed2f9a492c5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.084575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5c8b-64d3-4646-96a6-7ed2f9a492c5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.084838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5c8b-64d3-4646-96a6-7ed2f9a492c5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.086686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 240/499] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:47:59.087417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5c8b-64d3-4646-96a6-7ed2f9a492c5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.167434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3444c84-5355-4bfe-9c43-394678ba873d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.193742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:59.195024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5c8b-64d3-4646-96a6-7ed2f9a492c5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.203282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.203908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.204179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.204453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.206937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:59.216612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.218080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.233560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883e554-34b1-4eef-bb94-42032cccaedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:47:59.233808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:59.234688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:47:59.240438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:47:59.240438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:59.240438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:59.240604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e554-34b1-4eef-bb94-42032cccaedc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.240604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e554-34b1-4eef-bb94-42032cccaedc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.240604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e554-34b1-4eef-bb94-42032cccaedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.240773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 260/500] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:59.240773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.315949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e554-34b1-4eef-bb94-42032cccaedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.317748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e554-34b1-4eef-bb94-42032cccaedc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.347161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a105d4-767f-48c0-bd76-f00d31197764 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.381192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64ebd-b096-4712-9d4b-c63bdfaa0061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.381806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64ebd-b096-4712-9d4b-c63bdfaa0061 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.382077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64ebd-b096-4712-9d4b-c63bdfaa0061 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.383045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64ebd-b096-4712-9d4b-c63bdfaa0061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.393349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a64ebd-b096-4712-9d4b-c63bdfaa0061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.395105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a64ebd-b096-4712-9d4b-c63bdfaa0061 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-69a64ebd-b096-4712-9d4b-c63bdfaa0061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:47:59.409409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:59.410472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:47:59.411359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:47:59.411359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:59.411359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:59.411359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 261/501] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:59.411966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ff20-b3f0-48d3-a7dd-2cb7379391df None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.411966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ff20-b3f0-48d3-a7dd-2cb7379391df None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.412216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ff20-b3f0-48d3-a7dd-2cb7379391df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.422192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 241/502] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:47:59.423628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883e554-34b1-4eef-bb94-42032cccaedc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.429933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6ad3ff20-b3f0-48d3-a7dd-2cb7379391df None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:47:59.431134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6ad3ff20-b3f0-48d3-a7dd-2cb7379391df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:47:59.434102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:59.456086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:59.498894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 262/503] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:47:59.499649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3ff20-b3f0-48d3-a7dd-2cb7379391df None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.523220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883e554-34b1-4eef-bb94-42032cccaedc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.558046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.558639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.558945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.559218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.559851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:59.560151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.561504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.577516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 242/504] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:59.577516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.604549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3ff20-b3f0-48d3-a7dd-2cb7379391df None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.640860 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39361-c303-40b1-ba3a-2e4e9e04b880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.641504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39361-c303-40b1-ba3a-2e4e9e04b880 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.641784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39361-c303-40b1-ba3a-2e4e9e04b880 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.642053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39361-c303-40b1-ba3a-2e4e9e04b880 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.649932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:59.658694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea39361-c303-40b1-ba3a-2e4e9e04b880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-7ea39361-c303-40b1-ba3a-2e4e9e04b880 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:47:59.664385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:59.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:59.666130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 263/505] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:59.666799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39361-c303-40b1-ba3a-2e4e9e04b880 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.688946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea879-d741-4f21-8550-25b4f02103ae None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.690094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:59.726236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.726955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.727303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.727643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.728353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:59.728724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.730208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.742965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 243/506] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:59.744035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.779470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39361-c303-40b1-ba3a-2e4e9e04b880 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.813076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.813692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.813967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.814236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.824543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.825993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:47:59.841255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:59.842145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:47:59.843263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:47:59.843263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:47:59.843263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:47:59.843263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 264/507] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:59.843263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.852198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011e11a-c018-4b14-ae84-6997881a213e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.880018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:59.889368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.889987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.890262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.890531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.897533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.899965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:47:59.912507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:47:59.913546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 244/508] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:47:59.914895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:47:59.917448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:47:59.949215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090f2a6-d602-4ab4-af20-17564d41f9f0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:47:59.982151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:47:59.982743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:47:59.983048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:47:59.983315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:47:59.983996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:47:59.984296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:47:59.985667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:47:59.993375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 265/509] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:47:59.994153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.014843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10222d30-ccac-4e89-92a8-1dbe8c30952a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.048172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.048725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.049000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.049268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.057102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.058532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:00.069431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:00.070952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 245/510] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:00.071869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.094852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638591f-bc65-482c-a8e3-feeeacf2fcd1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.118693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.128599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.129223 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.129501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.129772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.131697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.141077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.142516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:00.156891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:00.157800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:00.158683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:00.158683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:00.158683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:00.158683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 266/511] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:00.158940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.172184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb5a72-2fb5-4b08-a7ec-b954deca0c17 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.204964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.205562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.205838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.206140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.206806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:00.207113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.208476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.225120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 246/512] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:00.225120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.261823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55af97f-6998-4849-98e7-0acb393bc2d2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.295770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.296365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.296638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.296906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.297621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:00.297926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.299426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.319844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584e2d4-4f0d-4d39-b25b-dc0f5cc79978 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.328835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.334685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 267/513] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:00.336023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.358425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.359072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.359349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.359616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.369985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.371456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.381740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:00.385883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:00.387002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:00.387854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:00.387854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:00.387854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:00.387854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 247/514] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:00.388215 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.440241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a498e23-2cb2-42a5-ae83-16b9433c13de None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.473003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.473605 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.473882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.474151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.474906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:00.475210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.476752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.486479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b796f0-a69f-4c08-8955-d2a89f868ddd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.493255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 268/515] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:00.494061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.521974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.522702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.523732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.524108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.524841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:00.525243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.526683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.538083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 248/516] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:00.539020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.561345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.595648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a93de-fbca-4fcd-b3ec-90daf2106ce8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.597301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.629873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.630511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.630821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.631092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.638111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.639574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.640305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2c1e9-874e-4449-a635-77833e0e0a5d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:00.652064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:00.653119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 269/517] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:00.654008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.679193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db11b-9963-455c-8db0-d682e9e684a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.679889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db11b-9963-455c-8db0-d682e9e684a3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.680169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db11b-9963-455c-8db0-d682e9e684a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.680440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6db11b-9963-455c-8db0-d682e9e684a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.746216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6db11b-9963-455c-8db0-d682e9e684a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.747685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6db11b-9963-455c-8db0-d682e9e684a3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.752997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b3ec1-c283-490e-bfde-09e0db546eb3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.768179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.786022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.786623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.786932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.787206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.787841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:00.788144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.790082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:00.801522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 270/518] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:00.802312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.826105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.850045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 249/519] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:00.850915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db11b-9963-455c-8db0-d682e9e684a3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:00.903165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710b215-f465-47b1-8bad-9da4b5c4e741 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.936953 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f99b2d-f373-43a1-8b5c-0cefb17cbbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.937553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f99b2d-f373-43a1-8b5c-0cefb17cbbfd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.937829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f99b2d-f373-43a1-8b5c-0cefb17cbbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.938097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f99b2d-f373-43a1-8b5c-0cefb17cbbfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.950872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6db11b-9963-455c-8db0-d682e9e684a3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:00.971060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:00.986061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a060f4c-73f0-4289-81a9-acc776fbf011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:00.986652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060f4c-73f0-4289-81a9-acc776fbf011 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:00.986953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060f4c-73f0-4289-81a9-acc776fbf011 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:00.987222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060f4c-73f0-4289-81a9-acc776fbf011 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:00.987853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a060f4c-73f0-4289-81a9-acc776fbf011 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:00.989273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a060f4c-73f0-4289-81a9-acc776fbf011 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.004792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f99b2d-f373-43a1-8b5c-0cefb17cbbfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.006226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f99b2d-f373-43a1-8b5c-0cefb17cbbfd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.009700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 250/520] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:48:00 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:01.010807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a060f4c-73f0-4289-81a9-acc776fbf011 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.032703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:01.121693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 271/521] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:01.122947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f99b2d-f373-43a1-8b5c-0cefb17cbbfd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.142727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a060f4c-73f0-4289-81a9-acc776fbf011 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.183736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.184349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.184624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.185457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:01.185554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:01.185863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.187886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.208091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 251/522] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:01.208896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.238739 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f99b2d-f373-43a1-8b5c-0cefb17cbbfd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.257481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:01.264038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:01.276853 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.277474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.277745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.278076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:01.287591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.290725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:01.301877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:01.302987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 272/523] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:01.310035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.335849 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dad2e-df43-4f0a-a333-b206c6f8bf20 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.372513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.373387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.373725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.374056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:01.385294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.386836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:01.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:01.402352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:01.403505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:01.403505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:01.403505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:01.403505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 252/524] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:01.407494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.411630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6a52c-8b23-4498-bbde-54d7382df90a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.446143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.446891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.447237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.447573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:01.458011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.459560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:01.473919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:01.475099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:01.481367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:01.481367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:01.481367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:01.481367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 273/525] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:01.481367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.505095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:01.515930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:01.520434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9292e4-c021-411e-9508-f2c4d8a79169 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.557538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.558135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.558408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.558675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:01.559421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=c0a3fcdfea364647ad88070a96793065) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:01.559723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.561134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.566784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 253/526] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/role_assignments?user.id=c0a3fcdfea364647ad88070a96793065&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:01.567492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.610298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2a1e-620e-4d19-9262-8219ebbc1a78 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.674734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.676487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.676974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.677728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:01.678874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:01.679740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.681644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.695838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a274ab3-34cb-40d5-a2b2-4b9560aa9dc5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.702516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 274/527] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:01.703436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.751146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.752950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.753432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.753886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:01.754971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:01.755378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.757219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.781785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 254/528] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:01.783065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.800454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:01.824847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:01.838959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a8a36-13b0-47f3-a9a0-34d66b7db663 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.889120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.890335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.890866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.891699 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:01.892544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:01.893017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:01.895216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:01.909161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f2161-8760-4ea1-8fa8-6af1260008dc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:01.917143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 275/529] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:01.917143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:01.956261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44158939-bc22-415a-977f-5fe69e6d9daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:01.956919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158939-bc22-415a-977f-5fe69e6d9daa None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:01.957197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158939-bc22-415a-977f-5fe69e6d9daa None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:01.957462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158939-bc22-415a-977f-5fe69e6d9daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.040623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44158939-bc22-415a-977f-5fe69e6d9daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.042366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44158939-bc22-415a-977f-5fe69e6d9daa None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.047634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4642c41-0bd4-48e5-96c3-3417cdeec8c2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.061097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:02.090049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.091073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.091549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.092007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.099306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.101553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:02.113805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:02.114653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:02.115517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:02.115517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:02.115517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:02.115517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:02.115517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:02.115517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:02.115517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:02.115517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:02.118009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 276/530] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:02.119174 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:02.136260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:02.175424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 255/531] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:02.176226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44158939-bc22-415a-977f-5fe69e6d9daa None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:02.228419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078d91-9b74-4bfa-9ae3-f2ba3cf2a090 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.264704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.266129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.266625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.267163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.274583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.276750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.287719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44158939-bc22-415a-977f-5fe69e6d9daa None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:02.291407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:02.292259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:02.293087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:02.293087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:02.293087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:02.293087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:02.293087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:02.293087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:02.293087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:02.293087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:02.299885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 277/532] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:02.301075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:02.302965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:02.327330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.327929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.328199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.328466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.329143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:02.329441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.330879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.350260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 256/533] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:02.351542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:02.387257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:02.418441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0d42f-7a8f-4fc9-8f2d-a55c44064ebe None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.462360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.463937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.464556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.465003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.466164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661e8a4-6649-461c-91f7-ca22e62d2f84 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.480349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.482699 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:02.501740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:02.502618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:02.503483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:02.503483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:02.503483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:02.504124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 278/534] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:02.504765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:02.506839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.507729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.508167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.508442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.509309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:02.509617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.511198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.530396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 257/535] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:02.531450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:02.565146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:02.631642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4e27c-167b-4a9f-a1d2-e68f9357b1a8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.645810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8245da-d402-4800-af11-5c890a94dbe4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.665653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:02.680664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.681638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.682373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.683110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.684028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=3b877cb99245408b8ca37c9e85eb023e) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:02.684635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.687018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.689826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.690497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.690858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.691456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.691876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:02.692237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.693632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.695074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 279/536] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:02 2022] GET /identity/v3/role_assignments?user.id=3b877cb99245408b8ca37c9e85eb023e&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:02.696285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:02.719860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 258/537] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:02.725241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:02.818166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76625a5d-8898-4fc9-b348-8b6fbf078edb None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.860071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.860989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.861907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.862354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:02.863412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=ac3f250eacf044f1b760f3b75d4ba33a) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:02.864031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:02.865825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:02.879787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 280/538] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:02 2022] GET /identity/v3/role_assignments?user.id=ac3f250eacf044f1b760f3b75d4ba33a&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:02.922745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:02.934318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c156-f181-4871-bcac-e70333163f83 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:02.987431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:02.988071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:02.988350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:02.988614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:03.001097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:03.002574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:03.016841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:03.017743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:03.018571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 259/539] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:03.024525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:03.093311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:03.145250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1222218-3a3d-4179-9655-9694576cd395 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:03.181495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bc0f2-a9e9-4b8a-bedb-5ef9344851c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:03.182103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bc0f2-a9e9-4b8a-bedb-5ef9344851c9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:03.182382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bc0f2-a9e9-4b8a-bedb-5ef9344851c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:03.182651 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bc0f2-a9e9-4b8a-bedb-5ef9344851c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:03.183372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bc0f2-a9e9-4b8a-bedb-5ef9344851c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:03.183675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bc0f2-a9e9-4b8a-bedb-5ef9344851c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:03.185102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bc0f2-a9e9-4b8a-bedb-5ef9344851c9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:03.208841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 281/540] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:03.215316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:03.361411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaf782-fc79-4dc4-9e5d-7af5c232dc40 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:03.361978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaf782-fc79-4dc4-9e5d-7af5c232dc40 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:03.362212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaf782-fc79-4dc4-9e5d-7af5c232dc40 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:03.363949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 282/541] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:03.373908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4d2d-6116-419b-9bb6-b0133422c118 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:03.374312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4d2d-6116-419b-9bb6-b0133422c118 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:03.374597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4d2d-6116-419b-9bb6-b0133422c118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:03.375742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9214b6-a9d6-4491-ab0d-438848eb85c9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:03.409709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d00b4d2d-6116-419b-9bb6-b0133422c118 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:03.410977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d00b4d2d-6116-419b-9bb6-b0133422c118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:03.421021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:03.421632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:03.421905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:03.422172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:03.423200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=f50dc809ff034866a1f6343e5b32609b) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:03.423509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:03.424970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:03.432366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 260/542] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:03 2022] GET /identity/v3/role_assignments?user.id=f50dc809ff034866a1f6343e5b32609b&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:03.486856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 283/543] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:48:03.796735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:03.820886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:03.895106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4c034-8a6b-47f6-8e2e-97c308457a9a None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:03.895424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4c034-8a6b-47f6-8e2e-97c308457a9a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:03.895654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4c034-8a6b-47f6-8e2e-97c308457a9a None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:03.898736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 284/544] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:03.902824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c4ce4-86c2-479a-84ac-859d27b326bd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:03.903108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c4ce4-86c2-479a-84ac-859d27b326bd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:03.903384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c4ce4-86c2-479a-84ac-859d27b326bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:03.930811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64220f89-d73e-41ea-b2b8-a90c9549bd20 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:03.942092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0e3c4ce4-86c2-479a-84ac-859d27b326bd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:03.943329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0e3c4ce4-86c2-479a-84ac-859d27b326bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:03.996065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144023a8-01e1-40f5-b130-b8be6fde05f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:03.996699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144023a8-01e1-40f5-b130-b8be6fde05f0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:03.996977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144023a8-01e1-40f5-b130-b8be6fde05f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:03.997249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144023a8-01e1-40f5-b130-b8be6fde05f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:04.019148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144023a8-01e1-40f5-b130-b8be6fde05f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-144023a8-01e1-40f5-b130-b8be6fde05f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:04.025518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:04.026427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:04.027246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 261/545] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:04.028981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:04.036317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144023a8-01e1-40f5-b130-b8be6fde05f0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:04.095696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 285/546] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:48:04.143351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:04.173854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144023a8-01e1-40f5-b130-b8be6fde05f0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:04.207989 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:04.208522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:04.208801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:04.209075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:04.209791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:04.210095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:04.212251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:04.220747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 262/547] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:04.226990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c4ce4-86c2-479a-84ac-859d27b326bd None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:04.361610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c4ce4-86c2-479a-84ac-859d27b326bd None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:04.407425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:04.408060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:04.408337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:04.408606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:04.423524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:04.425002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:04.426833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:04.468292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:04.469212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:04.470100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:04.470100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:04.470100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:04.472838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 286/548] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:04.477589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:04.527745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:04.597663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5a6c2-f4c8-4a72-8d2f-961c8a668d5d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:04.636249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2eb86-b32b-41ef-a8c8-fa336f22251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:04.636976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2eb86-b32b-41ef-a8c8-fa336f22251f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:04.637150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2eb86-b32b-41ef-a8c8-fa336f22251f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:04.637395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2eb86-b32b-41ef-a8c8-fa336f22251f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:04.658741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:04.661909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2eb86-b32b-41ef-a8c8-fa336f22251f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ebf2eb86-b32b-41ef-a8c8-fa336f22251f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:04.668897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:04.670505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:04.671607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:04.673914 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 263/549] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:04.683646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2eb86-b32b-41ef-a8c8-fa336f22251f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:04.686092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ccdb9-8740-4ebc-842e-40dfc66b7fef None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:04.752843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:04.753492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:04.753770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:04.754035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:04.754669 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:04.754989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:04.759760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:04.782140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 287/550] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:04.787642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:04.888279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2eb86-b32b-41ef-a8c8-fa336f22251f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:04.960105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:04.961454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:04.961832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:04.962105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:04.962791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:04.963081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:04.964442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:04.966536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:04.989936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789e8ab-d81a-4ffe-875b-596094b0f1fa None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:04.991692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 264/551] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:04.997358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:05.057432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:05.057987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.058889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.059344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.074712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:05.076419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:05.094260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:05.100194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:05.102378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:05.103464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 288/552] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:05.107603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:05.145770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9ce68-03ff-4629-82d2-ceaa081a387b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:05.193710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:05.194347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.195184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.195458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.218349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:05.219827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:05.248947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:05.250111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:05.251331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:05.251331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:05.251331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:05.251331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 265/553] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:05.261618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:05.305769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74d629-4fad-44bd-b866-b854ebc83f0c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:05.350334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:05.351045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.351341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.351586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.352438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:05.353034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:05.354462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:05.390536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 289/554] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Sep 24 04:48:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:05.397857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:05.402524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:05.436672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84168a1b-feef-4875-983d-ed8b968fa3a3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:05.452356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:05.475399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:05.476167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.476350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.476619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.477259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:05.477557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:05.478925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:05.498301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 266/555] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:05.499740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:05.537717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2123-c38c-4e48-8699-f9f3b334ba2f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:05.579057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d6cd7-b10a-44c3-840c-00c4c1c2a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:05.580039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d6cd7-b10a-44c3-840c-00c4c1c2a3ca None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.580517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d6cd7-b10a-44c3-840c-00c4c1c2a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.581082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d6cd7-b10a-44c3-840c-00c4c1c2a3ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.607337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d03c7-6345-464d-b25e-7e267183d7c1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:05.647833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecdfbf-4b0b-4db7-8e25-4cdc4337642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:05.648704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdfbf-4b0b-4db7-8e25-4cdc4337642a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.649090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdfbf-4b0b-4db7-8e25-4cdc4337642a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.649362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdfbf-4b0b-4db7-8e25-4cdc4337642a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.657124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecdfbf-4b0b-4db7-8e25-4cdc4337642a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:05.658549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecdfbf-4b0b-4db7-8e25-4cdc4337642a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:05.660970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d6cd7-b10a-44c3-840c-00c4c1c2a3ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:05.662400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d6cd7-b10a-44c3-840c-00c4c1c2a3ca None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:05.664543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-68ecdfbf-4b0b-4db7-8e25-4cdc4337642a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:05.676687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:05.678136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 267/556] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b472-fb3a-4e29-8584-8548b65d68a6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.684985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b472-fb3a-4e29-8584-8548b65d68a6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.685690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b472-fb3a-4e29-8584-8548b65d68a6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.685690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 268/557] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:05.685690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819e3f0-e046-48ae-a62e-681c86f5dceb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.685690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819e3f0-e046-48ae-a62e-681c86f5dceb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.685690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819e3f0-e046-48ae-a62e-681c86f5dceb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.686945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 269/558] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:05.687745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810aa8-3b8c-47ae-99a1-301be8245de7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.688010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810aa8-3b8c-47ae-99a1-301be8245de7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.688274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810aa8-3b8c-47ae-99a1-301be8245de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.710423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-91810aa8-3b8c-47ae-99a1-301be8245de7 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:05.711666 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-91810aa8-3b8c-47ae-99a1-301be8245de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:05.739520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:05.775873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 290/559] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 04:48:05.775873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d6cd7-b10a-44c3-840c-00c4c1c2a3ca None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:05.805589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 270/560] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:48:05.807181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125b4d0-5f88-4863-b150-afc5d4bfdc2d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.807723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125b4d0-5f88-4863-b150-afc5d4bfdc2d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.808148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125b4d0-5f88-4863-b150-afc5d4bfdc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.827011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f125b4d0-5f88-4863-b150-afc5d4bfdc2d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:05.828467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f125b4d0-5f88-4863-b150-afc5d4bfdc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:05.892778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d6cd7-b10a-44c3-840c-00c4c1c2a3ca None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:05.895107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:05.918794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 271/561] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:05.918794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125b4d0-5f88-4863-b150-afc5d4bfdc2d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:05.974247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:05.975388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:05.978189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:05.978671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:05.979626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:05.980125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:05.981918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.017880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 291/562] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 24 04:48:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:06.025143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.092599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:06.102324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125b4d0-5f88-4863-b150-afc5d4bfdc2d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.137550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.138177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.138457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.138726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.149170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:06.151240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.156623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198b9e-53dd-4bce-b179-40d056f3c449 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:06.168175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:06.169082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:06.170048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:06.170048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:06.170048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:06.170612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 272/563] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:06.171319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.197981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c280bb5-7832-4100-a443-7d381be6fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.198602 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c280bb5-7832-4100-a443-7d381be6fc5d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.198912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c280bb5-7832-4100-a443-7d381be6fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.199183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c280bb5-7832-4100-a443-7d381be6fc5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.209716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c280bb5-7832-4100-a443-7d381be6fc5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:06.211265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c280bb5-7832-4100-a443-7d381be6fc5d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5c280bb5-7832-4100-a443-7d381be6fc5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:06.225513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:06.227143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:06.228020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:06.228020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:06.228020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:06.228020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 292/564] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:06.228020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc069a02-bae7-4ab0-9550-25b9d6052077 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.228304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc069a02-bae7-4ab0-9550-25b9d6052077 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.228304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc069a02-bae7-4ab0-9550-25b9d6052077 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.229514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 293/565] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:06.230205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc069a02-bae7-4ab0-9550-25b9d6052077 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.245204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:06.279325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23d22c-609b-48f6-a484-ae3ef423f762 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.313289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f18494-a7ad-4afa-bdd3-1236227a1df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.313913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f18494-a7ad-4afa-bdd3-1236227a1df3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.314190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f18494-a7ad-4afa-bdd3-1236227a1df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.314459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f18494-a7ad-4afa-bdd3-1236227a1df3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.325904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f18494-a7ad-4afa-bdd3-1236227a1df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b8f18494-a7ad-4afa-bdd3-1236227a1df3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:06.331164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:06.332108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:06.332983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 273/566] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:06.333693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc069a02-bae7-4ab0-9550-25b9d6052077 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.333777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f18494-a7ad-4afa-bdd3-1236227a1df3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.338412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:06.367408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.368005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.368288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.368560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.369198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:06.369498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:06.370885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.382107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 294/567] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:06.382927 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.438401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f18494-a7ad-4afa-bdd3-1236227a1df3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.450327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:06.471683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb362c7-6579-4bd0-8028-1050c8dbdc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.472301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb362c7-6579-4bd0-8028-1050c8dbdc7c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.472580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb362c7-6579-4bd0-8028-1050c8dbdc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.472851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb362c7-6579-4bd0-8028-1050c8dbdc7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.481237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec2ff6-60ce-48a8-8d0d-8e4df7953c52 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.482906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb362c7-6579-4bd0-8028-1050c8dbdc7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-dbb362c7-6579-4bd0-8028-1050c8dbdc7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:06.488110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:06.489079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:06.489935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 274/568] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:06.490650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7fd52-ba60-44ed-a29e-8c32b972aff0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.490650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7fd52-ba60-44ed-a29e-8c32b972aff0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.490960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7fd52-ba60-44ed-a29e-8c32b972aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.509029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1fa7fd52-ba60-44ed-a29e-8c32b972aff0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:06.510138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1fa7fd52-ba60-44ed-a29e-8c32b972aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:06.515717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.516318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.516597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.516869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.517503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:06.517818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:06.519203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.531623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 295/569] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:06.532415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.571701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:06.580353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 275/570] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:06.581160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7fd52-ba60-44ed-a29e-8c32b972aff0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.634082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779024-58e1-4130-9b21-abdfff427eed None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.670118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:06.676866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.677468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.677749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.678021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.678684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:06.679047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:06.681341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.691233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7fd52-ba60-44ed-a29e-8c32b972aff0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.697033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 296/571] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:06.697033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.727922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.728545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.728923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.729089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.735939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:06.737380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:06.749477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:06.750355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:06.751264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 276/572] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:06.751824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.802172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cd7df-bf41-4dfb-b4f5-c6bd5b6c0b84 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.814602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:06.836646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.837510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.837958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.838398 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.839304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:06.839674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:06.841028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.849647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 297/573] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:06.850346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.863353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edcd68-9567-480b-b35e-d4d0bd04923a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.896795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.897407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.898210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.898742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.905166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:06.905719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:06.906630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:06.918330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:06.919790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 277/574] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:06.920688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:06.954877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4cfb5-1676-47a1-ac7d-29bacef767b3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:06.987700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:06.988301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:06.988582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:06.988849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:06.999754 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.001209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:07.015640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:07.016753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:07.017647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:07.017647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:07.017647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:07.017647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 298/575] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:07.017884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.023667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff7271-541a-4e9d-9fc9-33b074149e6a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.037754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:07.058274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347360f-2946-468a-a706-217f406e343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.058899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347360f-2946-468a-a706-217f406e343d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.059178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347360f-2946-468a-a706-217f406e343d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.059447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347360f-2946-468a-a706-217f406e343d None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.060134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347360f-2946-468a-a706-217f406e343d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:07.060438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347360f-2946-468a-a706-217f406e343d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.061860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347360f-2946-468a-a706-217f406e343d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.073693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 278/576] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:07.074467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347360f-2946-468a-a706-217f406e343d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.126412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5745d-4309-4497-a237-b779390599f8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.134865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:07.159854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7493f43-c262-4cfa-b927-5e6906b51d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.160480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7493f43-c262-4cfa-b927-5e6906b51d51 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.160756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7493f43-c262-4cfa-b927-5e6906b51d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.161027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7493f43-c262-4cfa-b927-5e6906b51d51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.170925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7493f43-c262-4cfa-b927-5e6906b51d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:07.172103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347360f-2946-468a-a706-217f406e343d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e7493f43-c262-4cfa-b927-5e6906b51d51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:07.176057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:07.177178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:07.178253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:07.182565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 299/577] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:07.183354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7493f43-c262-4cfa-b927-5e6906b51d51 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.205886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.206449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.206717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.207028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.217323 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.218776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:07.233500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:07.234562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:07.235648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:07.235648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:07.235648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:07.235648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 279/578] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:07.235648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.262280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:07.284642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7493f43-c262-4cfa-b927-5e6906b51d51 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.318408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.319035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.319312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.319628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.320325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:07.320634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.322094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.338791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 300/579] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:07.338791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.339059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ca17-b4ae-44dc-a785-aa0449e1de80 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.362723 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:07.374279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.374908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.375182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.375454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.376091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:07.376394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.377773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.389155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 280/580] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:07.390109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.434020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddccd99-eec0-43dc-bb15-874b0f392c78 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.466496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.467125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.467292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.467563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.468276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=473bfd2bae82474e81232a3bb364e5bc) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:07.468580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.469990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.472110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:07.475578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 301/581] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/role_assignments?user.id=473bfd2bae82474e81232a3bb364e5bc&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:07.477498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.496501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcd415-a62e-460c-a205-0651daa7e5a2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.536873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.537496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.537778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.538038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.538798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:07.539108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.540501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.550447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 281/582] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:07.551406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.589967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:07.599094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ba11-f9e9-4439-a0b2-81692677ea67 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.635178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.636655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.636941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.637214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.637869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:07.638173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.639595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.655388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 302/583] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:07.656256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.674573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae6f6-58b7-47d5-a118-9318d08f4e62 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.709255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1796e-5699-45f1-ae16-34d5ef30b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.709901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1796e-5699-45f1-ae16-34d5ef30b721 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.710706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1796e-5699-45f1-ae16-34d5ef30b721 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.711007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1796e-5699-45f1-ae16-34d5ef30b721 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/c0a3fcdfea364647ad88070a96793065/roles/7b269dca2b46421da0128d1e2da8d456` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.725649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1796e-5699-45f1-ae16-34d5ef30b721 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=c0a3fcdfea364647ad88070a96793065, role_id=7b269dca2b46421da0128d1e2da8d456)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.727939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1796e-5699-45f1-ae16-34d5ef30b721 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.736527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:07.750781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 282/584] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:07 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/c0a3fcdfea364647ad88070a96793065/roles/7b269dca2b46421da0128d1e2da8d456 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:07.752384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1796e-5699-45f1-ae16-34d5ef30b721 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.777493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecf527-8fe0-44be-8d04-c820b1a8d64a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.816555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.817548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.817923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.818299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.828036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.829851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:07.843780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:07.845069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 04:48:07.846252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:07.847731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 303/585] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:07.848776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:07.867677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:07.884887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1796e-5699-45f1-ae16-34d5ef30b721 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.935060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:07.936466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:07.936896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:07.937353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:07.951626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:07.953407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:07.967063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04808cfa-3a8b-4bff-9a49-cc1e2d44f389 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:07.970791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:07.971768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:07.972683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:07.972683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:07.972683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:07.972683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 283/586] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:07.972906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.011907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.012409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.012688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.013020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.023659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.025203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:08.044926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:08.045921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:08.046894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 304/587] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:08.047772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.049337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:08.093472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b599ec9-8f26-47fb-b2de-eb8f4944ab53 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.136614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.137212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.137485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.137751 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.138475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:08.139083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.140520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:08.142487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.168771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 284/588] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 24 04:48:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:08.171564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.188516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198ef36-cdac-4cfc-b7fc-473b569642b8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.234271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.235296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.235582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.235850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.236493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:08.236793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.238152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.258839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 305/589] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:08.260034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.303268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f4728-5756-4682-ab49-cfe713d56369 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.314487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:08.344440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.345039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.345317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.345583 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.346305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:08.346608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.348057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.369935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 285/590] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:08.370990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.372489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa055e6-bb65-4394-bae5-7dbe31f723af None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.412435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:08.421573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.422448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.422952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.423439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.437963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.440618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:08.465728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:08.467305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:08.468261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:08.468261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:08.468261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:08.471761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 306/591] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:08.472262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.504488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3bf5a-3ce2-45b9-a3b1-ce1ac6699a3a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.550112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.551152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.551638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.552164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.562364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.564240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.577672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51110-1529-4234-a8e0-9373270b43bd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:08.579665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:08.580600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 04:48:08.581548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:08.584168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 286/592] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:08.585874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.622086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:08.624118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.626168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.626168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.626168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.637464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.639086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:08.654800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:08.655850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:08.656718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:08.656718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:08.656718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:08.656718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 307/593] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:08.657395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.695122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:08.716693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0a714-c6f7-4e85-a0cd-d77ce835e53e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.764881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.765754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.765919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.766275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.767037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:08.767407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.768826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.779621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ae87c-c569-49e0-a5bc-f2d3c63fb560 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.783334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 287/594] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:08.785247 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.817645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.818598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.819124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.820121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.821043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:08.821558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.823226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.841288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 308/595] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:08.842456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.896544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:08.917045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15140c95-ea16-41ea-88c2-34cfc58206b6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.938527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:08.946917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6453be-5c31-4f9f-a5cc-d634d4e147af None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:08.955063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.955656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.955994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.956267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.957038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:08.957241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.958596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:08.971507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 288/596] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:08.972420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:08.986572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:08.987550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:08.988087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:08.988575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:08.995957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:08.997648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:09.010115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:09.011274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:09.012183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:09.012183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:09.012183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:09.012183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:09.012183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:09.012183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:09.012183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:09.012183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:09.014484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 309/597] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:09.015536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:09.090193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45b98c-8c90-485d-a7e9-e878212c1711 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.122826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fbd76-a99d-474c-87e7-33955a7e28d4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.131553 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.132239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.132513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.132852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.148455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.150904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.159569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:09.162315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.162971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.163302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.163566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.170928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:09.171677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:09.172584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:09.173459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:09.173459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:09.173459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:09.173640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.180206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 289/598] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:09.181248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:09.186645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:09.187744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:09.188858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:09.188858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:09.188858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:09.188858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:09.188858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:09.188858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:09.188858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:09.188858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:09.190393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 310/599] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:09.191381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:09.208556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:09.297874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45f7b0-fb4b-4540-b854-53686366fb10 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.299507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1714-ded3-4005-be09-14fc082f6247 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.333727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.334467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.334810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.334954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.335807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.336436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.336633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:09.337025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.337136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.337538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.338364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:09.338720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.339000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.340714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.357167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 311/600] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:09.357167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:09.360329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 290/601] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:09.361433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:09.432031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:09.439416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:09.466744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909c8a-af8b-4682-a555-6559d64d5688 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.485584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686967f-8875-492f-a8d3-41dfe65de1c2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.501538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.502321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.502797 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.503187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.503918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:09.504318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.505934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.519681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 312/602] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:09.520615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:09.527842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.528687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.529125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.529539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.536867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.539860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:09.552457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:09.553535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:09.554694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:09.554694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:09.554694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:09.554694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:09.554694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:09.554694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:09.554694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:09.554694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:09.561967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 291/603] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:09.563095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:09.634484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac636-60c3-412b-a973-1ac7e7bf7626 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.675142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d392b-775d-4e98-a91a-9513a354f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.675924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d392b-775d-4e98-a91a-9513a354f201 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.676312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d392b-775d-4e98-a91a-9513a354f201 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.676675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d392b-775d-4e98-a91a-9513a354f201 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/ac3f250eacf044f1b760f3b75d4ba33a/roles/7b269dca2b46421da0128d1e2da8d456` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.679619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:09.694321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d392b-775d-4e98-a91a-9513a354f201 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=ac3f250eacf044f1b760f3b75d4ba33a, role_id=7b269dca2b46421da0128d1e2da8d456)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.696760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d392b-775d-4e98-a91a-9513a354f201 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.701567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1e02c-62b7-497d-afa3-810697f38724 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.710234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 313/604] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:09 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/ac3f250eacf044f1b760f3b75d4ba33a/roles/7b269dca2b46421da0128d1e2da8d456 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:09.713299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d392b-775d-4e98-a91a-9513a354f201 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:09.728349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:09.750335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3cb30-11d5-4cb8-b094-d1e13ccca22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.751106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3cb30-11d5-4cb8-b094-d1e13ccca22f None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.751387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3cb30-11d5-4cb8-b094-d1e13ccca22f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.751659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3cb30-11d5-4cb8-b094-d1e13ccca22f None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/3b877cb99245408b8ca37c9e85eb023e/roles/7b269dca2b46421da0128d1e2da8d456` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.770350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3cb30-11d5-4cb8-b094-d1e13ccca22f None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=3b877cb99245408b8ca37c9e85eb023e, role_id=7b269dca2b46421da0128d1e2da8d456)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.772098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3cb30-11d5-4cb8-b094-d1e13ccca22f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.797907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 292/605] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:09 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/3b877cb99245408b8ca37c9e85eb023e/roles/7b269dca2b46421da0128d1e2da8d456 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:09.800060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa291b-7df4-42cf-8bda-41d216a9eb1b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.800350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa291b-7df4-42cf-8bda-41d216a9eb1b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.800624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa291b-7df4-42cf-8bda-41d216a9eb1b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.802969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 293/606] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:09.809479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5517-42a4-4469-aa3a-53fc8dc8214a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.809821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5517-42a4-4469-aa3a-53fc8dc8214a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.810100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5517-42a4-4469-aa3a-53fc8dc8214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.835608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bbda5517-42a4-4469-aa3a-53fc8dc8214a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:09.837836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bbda5517-42a4-4469-aa3a-53fc8dc8214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:09.896731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d392b-775d-4e98-a91a-9513a354f201 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:09.931810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 294/607] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:09.960963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:09.962069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:09.962500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:09.962988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:09.963894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:09.964341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:09.965942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:09.979589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 314/608] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:09.987181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda5517-42a4-4469-aa3a-53fc8dc8214a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:10.097360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:10.103826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda5517-42a4-4469-aa3a-53fc8dc8214a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:10.154509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dd382-95a8-4de1-bed1-6cb5eb165c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:10.155116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd382-95a8-4de1-bed1-6cb5eb165c19 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:10.155395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd382-95a8-4de1-bed1-6cb5eb165c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:10.155668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd382-95a8-4de1-bed1-6cb5eb165c19 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/f50dc809ff034866a1f6343e5b32609b/roles/7b269dca2b46421da0128d1e2da8d456` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:10.176954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dd382-95a8-4de1-bed1-6cb5eb165c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=f50dc809ff034866a1f6343e5b32609b, role_id=7b269dca2b46421da0128d1e2da8d456)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:10.178495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dd382-95a8-4de1-bed1-6cb5eb165c19 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:10.194668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 295/609] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:09 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/f50dc809ff034866a1f6343e5b32609b/roles/7b269dca2b46421da0128d1e2da8d456 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:10.287050 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:10.297963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266676b-5682-41a0-bb48-ed688f44a5fe None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:10.298245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266676b-5682-41a0-bb48-ed688f44a5fe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:10.298520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266676b-5682-41a0-bb48-ed688f44a5fe None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:10.299935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 296/610] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:48:10.306222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aab97-63eb-403d-9110-e9c5d5716265 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:10.306492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aab97-63eb-403d-9110-e9c5d5716265 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:10.306780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aab97-63eb-403d-9110-e9c5d5716265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:10.340781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:10.343852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-352aab97-63eb-403d-9110-e9c5d5716265 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:10.345324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-352aab97-63eb-403d-9110-e9c5d5716265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:10.416729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a9c88-c3cb-4ae8-b78e-2efd4b97d0dd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:10.458987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 297/611] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 04:48:10.466803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1a66-6240-49ff-8534-5436a4dd970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:10.468128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1a66-6240-49ff-8534-5436a4dd970d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:10.468597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1a66-6240-49ff-8534-5436a4dd970d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:10.469058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1a66-6240-49ff-8534-5436a4dd970d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:10.485711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1a66-6240-49ff-8534-5436a4dd970d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-de7c1a66-6240-49ff-8534-5436a4dd970d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:10.491084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:10.492251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:10.493722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 315/612] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:10.500120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aab97-63eb-403d-9110-e9c5d5716265 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:10.617112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:10.646569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aab97-63eb-403d-9110-e9c5d5716265 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:10.692579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:10.693105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:10.693381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:10.693656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:10.694319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:10.694867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:10.699017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:10.707771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 298/613] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:10.714482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1a66-6240-49ff-8534-5436a4dd970d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:10.831364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1a66-6240-49ff-8534-5436a4dd970d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:10.833707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:10.878140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:10.878793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:10.879075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:10.879345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:10.890077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:10.891567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:10.907286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:10.908274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:10.909823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:10.909823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:10.909823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:10.909823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 316/614] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:10.914199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:10.918251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:11.069040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce6ca6-fe04-463c-90e9-ef21ac4b3324 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:11.092150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748126-44f3-442a-bb40-83116604b268 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:11.111118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55c005-c5ce-414b-b923-af8948cdc134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:11.111762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55c005-c5ce-414b-b923-af8948cdc134 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:11.112034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55c005-c5ce-414b-b923-af8948cdc134 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:11.112347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55c005-c5ce-414b-b923-af8948cdc134 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:11.125039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55c005-c5ce-414b-b923-af8948cdc134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-fa55c005-c5ce-414b-b923-af8948cdc134 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:11.131061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:11.132711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:11.135024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 317/615] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:11.138818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55c005-c5ce-414b-b923-af8948cdc134 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:11.160268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:11.180258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:11.180874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:11.181153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:11.181425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:11.182112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:11.182416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:11.183797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:11.203582 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:11.210343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 299/616] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:11.213846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:11.263001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55c005-c5ce-414b-b923-af8948cdc134 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:11.330066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:11.330591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:11.330893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:11.331164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:11.331830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:11.332132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:11.333517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:11.353544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 318/617] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:11.358942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:11.376957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426c625-93a5-495f-8d2f-d2fa925a8fd0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:11.435340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:11.438858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:11.439344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:11.439786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:11.450255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:11.452058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:11.480199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:11.481173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:11.482096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:11.484624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 300/618] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:11.490238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:11.497120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:11.531698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb5519-2983-44c9-9cd6-fc31d1e06d86 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:11.575974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:11.576595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:11.576871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:11.577589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:11.589698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:11.591647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:11.607354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:11.608507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:11.609415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:11.609415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:11.609415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:11.609415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 319/619] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:11.613052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:11.615874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:11.699538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b344-26dd-4724-97be-ab4a549c0fd6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:11.749402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:11.750009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:11.750286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:11.750560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:11.751317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:11.751622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:11.753045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:11.779237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 301/620] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Sep 24 04:48:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:11.785018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:11.819802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2aa5b-5ae0-4a46-b841-a3e89bf9e317 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:11.876132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:11.889046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:11.889650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:11.889989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:11.890261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:11.891530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:11.891837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:11.893202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:11.911325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 320/621] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:11.927264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:11.945120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d4cd6-9dc3-4372-b7c4-d9cef1c02c07 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:11.964868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:11.984586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:11.985569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:11.986039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:11.986508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:11.997879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:11.999887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:12.016141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:12.017093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:12.017970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:12.017970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:12.017970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:12.020031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 302/622] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:12.033988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:12.120409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c853-8d3a-4a46-b4de-08ef001565cf None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:12.144655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc2db7-1002-4114-a59d-c3f6981e8fa8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:12.190059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:12.190695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.190998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.191267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.207126 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:12.208600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:12.213820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:12.214439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.214718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.215016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.215668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:12.215970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:12.221915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:12.240887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:12.242715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 04:48:12.243700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:12.245942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 321/623] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:12.246130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 303/624] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:12.250531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:12.251600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:12.299701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:12.365326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:12.434952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c403-b38c-4c6c-b7be-fff24d51a21d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:12.485796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27a59c-25fd-4313-a422-a27002346769 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:12.496024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db971d4a-dcbc-49bb-970d-9d407656929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:12.496632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971d4a-dcbc-49bb-970d-9d407656929d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.496906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971d4a-dcbc-49bb-970d-9d407656929d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.497173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971d4a-dcbc-49bb-970d-9d407656929d None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.497903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db971d4a-dcbc-49bb-970d-9d407656929d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:12.498463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db971d4a-dcbc-49bb-970d-9d407656929d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:12.499926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db971d4a-dcbc-49bb-970d-9d407656929d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:12.521165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 304/625] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 24 04:48:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:12.523482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021a86-5c42-4aae-ab02-cbb9b71b7e54 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.523873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021a86-5c42-4aae-ab02-cbb9b71b7e54 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.524241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021a86-5c42-4aae-ab02-cbb9b71b7e54 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.525919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 305/626] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:12.527456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021a86-5c42-4aae-ab02-cbb9b71b7e54 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:12.544368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefc996-5dc8-420d-84ca-0d01a53fb1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:12.545721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefc996-5dc8-420d-84ca-0d01a53fb1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.546290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefc996-5dc8-420d-84ca-0d01a53fb1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.546848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefc996-5dc8-420d-84ca-0d01a53fb1a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.555602 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefc996-5dc8-420d-84ca-0d01a53fb1a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:12.557416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefc996-5dc8-420d-84ca-0d01a53fb1a4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-beefc996-5dc8-420d-84ca-0d01a53fb1a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:12.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:12.575233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:12.576122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:12.576122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:12.576122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:12.576122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:12.576122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:12.576122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:12.576122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:12.576122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:12.579532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 322/627] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:12.581105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bea8e-e4a4-4b74-bc74-954cb471cee6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.581379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bea8e-e4a4-4b74-bc74-954cb471cee6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.581644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bea8e-e4a4-4b74-bc74-954cb471cee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.605472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-333bea8e-e4a4-4b74-bc74-954cb471cee6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:12.606876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-333bea8e-e4a4-4b74-bc74-954cb471cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:12.634256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:12.652295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021a86-5c42-4aae-ab02-cbb9b71b7e54 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:12.686411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 323/628] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:12.688078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42bc3-e577-476e-a8e8-08f7081225e1 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.688568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42bc3-e577-476e-a8e8-08f7081225e1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.689059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42bc3-e577-476e-a8e8-08f7081225e1 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.690504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 324/629] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:12.691436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42bc3-e577-476e-a8e8-08f7081225e1 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:12.701649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52aaf55-a3fd-4392-985d-a3a3765f8b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:12.702255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aaf55-a3fd-4392-985d-a3a3765f8b4b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.702588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aaf55-a3fd-4392-985d-a3a3765f8b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.702907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aaf55-a3fd-4392-985d-a3a3765f8b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.739273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:12.776506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52aaf55-a3fd-4392-985d-a3a3765f8b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:12.777960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52aaf55-a3fd-4392-985d-a3a3765f8b4b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:12.805135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42bc3-e577-476e-a8e8-08f7081225e1 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:12.842506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee740ca-fed1-4db1-b7ee-13ab31e18323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:12.843138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee740ca-fed1-4db1-b7ee-13ab31e18323 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.843417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee740ca-fed1-4db1-b7ee-13ab31e18323 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.843689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee740ca-fed1-4db1-b7ee-13ab31e18323 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.844378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee740ca-fed1-4db1-b7ee-13ab31e18323 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:12.844688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee740ca-fed1-4db1-b7ee-13ab31e18323 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:12.846110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee740ca-fed1-4db1-b7ee-13ab31e18323 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:12.857918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 325/630] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:12.860484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174024-317c-452c-9969-8c3d8b3272d9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.860872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174024-317c-452c-9969-8c3d8b3272d9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.861245 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174024-317c-452c-9969-8c3d8b3272d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.872759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:12.880143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fb174024-317c-452c-9969-8c3d8b3272d9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:12.881260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fb174024-317c-452c-9969-8c3d8b3272d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:12.891013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 306/631] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:12.891013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1bd2f-0cf2-44cf-82b8-bd4ceea2ba0a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:12.891013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1bd2f-0cf2-44cf-82b8-bd4ceea2ba0a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:12.891013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1bd2f-0cf2-44cf-82b8-bd4ceea2ba0a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:12.891013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 307/632] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:12.891013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1bd2f-0cf2-44cf-82b8-bd4ceea2ba0a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:12.952776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 326/633] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:12.953541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174024-317c-452c-9969-8c3d8b3272d9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:12.989803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:13.007374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1bd2f-0cf2-44cf-82b8-bd4ceea2ba0a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.043405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a39751-c2b4-4350-ac50-6404c389e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.044178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39751-c2b4-4350-ac50-6404c389e7e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.044448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39751-c2b4-4350-ac50-6404c389e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.044716 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39751-c2b4-4350-ac50-6404c389e7e5 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/473bfd2bae82474e81232a3bb364e5bc/roles/7b269dca2b46421da0128d1e2da8d456` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.059461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a39751-c2b4-4350-ac50-6404c389e7e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=473bfd2bae82474e81232a3bb364e5bc, role_id=7b269dca2b46421da0128d1e2da8d456)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:13.060891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a39751-c2b4-4350-ac50-6404c389e7e5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:13.068902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174024-317c-452c-9969-8c3d8b3272d9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.082785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 308/634] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:12 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/473bfd2bae82474e81232a3bb364e5bc/roles/7b269dca2b46421da0128d1e2da8d456 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:13.082785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171f858-34d5-4ac6-9906-5904c4073029 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.082785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171f858-34d5-4ac6-9906-5904c4073029 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.082785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171f858-34d5-4ac6-9906-5904c4073029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.102783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8171f858-34d5-4ac6-9906-5904c4073029 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:13.104242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8171f858-34d5-4ac6-9906-5904c4073029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:13.123747 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.124385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.124663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.124932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.136793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:13.138250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:13.142743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:13.155690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:13.156901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:13.157779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:13.157779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:13.157779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:13.157779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 327/635] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:13.162468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.202226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 309/636] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:13.203432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171f858-34d5-4ac6-9906-5904c4073029 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.274366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:13.299857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1864d-5c6c-470e-88f1-784170f1a3a8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.336508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171f858-34d5-4ac6-9906-5904c4073029 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.341752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f88d1b-7c63-4b1a-a894-e4ae18bf155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.342560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88d1b-7c63-4b1a-a894-e4ae18bf155f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.343046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88d1b-7c63-4b1a-a894-e4ae18bf155f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.343481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88d1b-7c63-4b1a-a894-e4ae18bf155f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.358988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f88d1b-7c63-4b1a-a894-e4ae18bf155f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e3f88d1b-7c63-4b1a-a894-e4ae18bf155f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:13.367674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:13.368856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 328/637] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:13.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f88d1b-7c63-4b1a-a894-e4ae18bf155f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.378669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.379510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.379985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.380396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.381285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:13.381730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:13.383343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:13.396926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 310/638] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:13.398278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.431902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:13.488177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f88d1b-7c63-4b1a-a894-e4ae18bf155f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.524618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4c2bf-9fd3-484c-a936-e9cc4c2d5016 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.531847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1a8c-142e-4c28-bbfc-3a72897ee11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.532586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1a8c-142e-4c28-bbfc-3a72897ee11f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.532864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1a8c-142e-4c28-bbfc-3a72897ee11f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.533137 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1a8c-142e-4c28-bbfc-3a72897ee11f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.545969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc1a8c-142e-4c28-bbfc-3a72897ee11f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cddc1a8c-142e-4c28-bbfc-3a72897ee11f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:13.551736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:13.552673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:13.553532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 329/639] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:13.555309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1a8c-142e-4c28-bbfc-3a72897ee11f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.556971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:13.564995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.565597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.565876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.566146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.566831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:13.567136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:13.568476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:13.578040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 311/640] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:13.578684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.670695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1a8c-142e-4c28-bbfc-3a72897ee11f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.677556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:13.689493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431018-b655-4619-b9af-9ed2ea2d8f6e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.706730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.707386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.707849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.708125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.714734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:13.716214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:13.726670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ae509-e524-4ce0-b020-2cd70cf85fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.727330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae509-e524-4ce0-b020-2cd70cf85fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:13.727532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:13.728366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:13.729270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:13.729270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:13.729270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:13.729270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:13.729270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:13.729270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:13.729270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:13.729270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:13.729688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae509-e524-4ce0-b020-2cd70cf85fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.729688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae509-e524-4ce0-b020-2cd70cf85fe6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.729814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 330/641] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:13.729814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.741092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ae509-e524-4ce0-b020-2cd70cf85fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7e4ae509-e524-4ce0-b020-2cd70cf85fe6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:13.747327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:13.748755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:13.749595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 312/642] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:13.750299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ae509-e524-4ce0-b020-2cd70cf85fe6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.807160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:13.848742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff7ed8-cce3-4d3d-948c-0bdaeea29406 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.857139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ae509-e524-4ce0-b020-2cd70cf85fe6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:13.885104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.885712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.885995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.886258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.886950 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:13.887251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:13.888647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:13.894022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:13.894622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:13.894929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:13.895279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:13.901732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 331/643] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:13.901732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.911171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:13.912621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:13.927882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:13.929370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:13.930439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:13.930439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:13.930439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:13.930439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 313/644] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:13.930439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:13.933564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:14.007667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90b0c7-2c61-4612-8125-627704e2ff5c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.033368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:14.045762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.046370 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.046476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab74e-7dda-49c8-9d16-1b1d2abfbd5b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.046654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.046938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.047625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:14.048099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.050383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.071751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 332/645] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:14.071751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.086364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.087152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.087430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.087697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.088352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:14.088657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.090017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.098489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 314/646] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:14.103988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.168937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:14.179122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e4dc-3493-4b90-844b-d6a8ebdd13d9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.209328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08f542-5b4e-4189-ba01-db4f1edc6383 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.214249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.214893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.215170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.215440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.226467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.228187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:14.243450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:14.244428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:14.245331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:14.245331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:14.245331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:14.245503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.245503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.245503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.245719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 333/647] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:14.245719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.249612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.250302 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:14.250623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.252005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.264727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 315/648] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:14.265477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.283312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:14.353844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bed2a-9b94-4886-a61e-5fc68860dcb9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.378983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e094f-98f6-4008-8c83-3086d7f248cc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.391798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.392431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.392714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.392988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.393718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=c0a3fcdfea364647ad88070a96793065) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:14.394029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.395488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.402320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 334/649] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/role_assignments?user.id=c0a3fcdfea364647ad88070a96793065&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:14.403151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.416033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:14.431507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.432476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.432934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.433727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.448004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.449780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:14.468918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:14.469959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:14.470896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:14.470896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:14.470896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:14.477974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 316/650] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:14.477974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.526769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:14.530576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abcd72-4991-4f91-b023-2fff8c427710 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.576980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.577642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.577917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.578094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.578734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:14.579657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.580936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.598009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 335/651] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:14.601504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.632463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074da75-1e55-4c6c-ba1f-4302f9ab0ec5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.690482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.690707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.690965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.691577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.702549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.704775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:14.719820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:14.720801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:14.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 317/652] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:14.722329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.734354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f5bc-3ffe-44f7-8a79-c74db6fdf938 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.761639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:14.782254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.783046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.784072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.784345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.784995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:14.785297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.786658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.804952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 336/653] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:14.806442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.836926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:14.844881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6dd26-96ab-44d8-a8f4-7c46f68d9c2d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.893657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.894653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.895181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.895693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.907290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.909033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:14.922046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:14.923074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:14.924039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 318/654] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:14.924647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:14.927027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f1de-9355-42b0-873a-1cf2ff5325cc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:14.984981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:14.986083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:14.987031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:14.987854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:14.988942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:14.989456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:14.991509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:15.016420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 337/655] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:15.017646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:15.041407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:15.049617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f0693-f10d-4744-81d3-c471d0d6643c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:15.092523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:15.093602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.094087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.094576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.105517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:15.107378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:15.112921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:15.126645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:15.127703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 04:48:15.128694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:15.132273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 319/656] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:15.133366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:15.141264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbfdd4-def7-4281-a37d-e1be66111171 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:15.176606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:15.177203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.177477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.177750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.178459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:15.179422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:15.180936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:15.198781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 338/657] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:48:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:15.199742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:15.258114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b6f47-646e-434e-8488-14c50a277de3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:15.298106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ae25a-1707-4b71-a6a0-18da2b177ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:15.298691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ae25a-1707-4b71-a6a0-18da2b177ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.299002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ae25a-1707-4b71-a6a0-18da2b177ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.299269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ae25a-1707-4b71-a6a0-18da2b177ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.331952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:15.347137 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5983c2e-1d66-43b7-8ba5-444436f784f4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:15.385157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ae25a-1707-4b71-a6a0-18da2b177ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:15.386865 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ae25a-1707-4b71-a6a0-18da2b177ab0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:15.393795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:15.394678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.395191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.395707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.396691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:15.398248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:15.400504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:15.404368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:15.423662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 339/658] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Sep 24 04:48:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:15.424781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:15.508733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 320/659] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:15.511037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1107-63b4-4bab-ad05-da72c49314ff None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.511695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1107-63b4-4bab-ad05-da72c49314ff None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.512222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1107-63b4-4bab-ad05-da72c49314ff None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.513860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 321/660] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:15.514711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d1107-63b4-4bab-ad05-da72c49314ff None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:15.538033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e63c2-abb8-4572-aae2-1edca5b08706 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:15.573803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5af2-b557-4400-a540-281bea132be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:15.574328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5af2-b557-4400-a540-281bea132be0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.574609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5af2-b557-4400-a540-281bea132be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.574912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5af2-b557-4400-a540-281bea132be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.581417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:15.632896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d1107-63b4-4bab-ad05-da72c49314ff None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:15.639524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:15.649974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f5af2-b557-4400-a540-281bea132be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:15.651471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f5af2-b557-4400-a540-281bea132be0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:15.674803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370bcb0-3c1d-4e61-ab81-4a196bf04164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:15.675398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370bcb0-3c1d-4e61-ab81-4a196bf04164 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.675676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370bcb0-3c1d-4e61-ab81-4a196bf04164 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.676182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370bcb0-3c1d-4e61-ab81-4a196bf04164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.751515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370bcb0-3c1d-4e61-ab81-4a196bf04164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:15.753072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370bcb0-3c1d-4e61-ab81-4a196bf04164 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:15.754999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 340/661] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:15.755913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5af2-b557-4400-a540-281bea132be0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:15.818669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:15.857772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:15.865258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5af2-b557-4400-a540-281bea132be0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:15.876075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 322/662] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:15.876075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857528-28b5-4899-a6c5-4addb9051138 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.876075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857528-28b5-4899-a6c5-4addb9051138 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.876075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857528-28b5-4899-a6c5-4addb9051138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.894346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5f857528-28b5-4899-a6c5-4addb9051138 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:15.895559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5f857528-28b5-4899-a6c5-4addb9051138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:15.901535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:15.902152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:15.902425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:15.902688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:15.912988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:15.914481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:15.929176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:15.930340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:15.931384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:15.931384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:15.931384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:15.931384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 341/663] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:15.931625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:15.971200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 323/664] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:15.972264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857528-28b5-4899-a6c5-4addb9051138 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.068958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:16.081205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857528-28b5-4899-a6c5-4addb9051138 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.119992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.121231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.121661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.122140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.134165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:16.135863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:16.152657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:16.153833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:16.154959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:16.154959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:16.154959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:16.161520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 324/665] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:16.162605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.216713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730004a-4190-4b31-9df8-b7df47e9f5e4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.266182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.268911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.269169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.269446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.278858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2722-9779-49d5-a3f7-ec4d9bf00d54 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.304182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:16.305662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:16.319871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.320921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.321033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:16.321868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.322354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.323577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:16.324408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:16.326224 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:16.331011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:16.331951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:16.332847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:16.332847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:16.332847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:16.332847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 342/666] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:16.333477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.339085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:16.347257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 325/667] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:16.348211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.464596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13266f31-4e7e-4f94-b7f1-23f18e3f0291 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.469763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152f011-e0b6-476b-affd-049aa7ec7b67 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.501349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fde83-ad61-43f5-8feb-1709cf36d96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.501982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fde83-ad61-43f5-8feb-1709cf36d96d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.502260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fde83-ad61-43f5-8feb-1709cf36d96d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.502533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fde83-ad61-43f5-8feb-1709cf36d96d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.507131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.507905 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.508340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.508608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.509249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:16.509550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:16.510960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:16.513392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fde83-ad61-43f5-8feb-1709cf36d96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ef9fde83-ad61-43f5-8feb-1709cf36d96d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:16.518267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:16.519295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 326/668] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:16.520150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fde83-ad61-43f5-8feb-1709cf36d96d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.532362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 343/669] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:16.533315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.592143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:16.603114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:16.641171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fde83-ad61-43f5-8feb-1709cf36d96d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.655176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17764f5-baea-4dce-ae58-cc03dc09eea9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.687542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.688165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.688460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.688714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.689351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:16.689815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:16.691089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:16.694700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.695496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.695770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.696036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.702780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:16.707724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 327/670] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:16.707724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.707931 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:16.720921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:16.721831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 344/671] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:16.728335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.816530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0e734-2458-4d51-8cf7-024aa039b35e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.825552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7695-9da5-40bb-8811-685fdc2d2f9d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.833376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:16.842917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:16.851379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.852090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.852359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.852621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.853260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:16.853573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:16.854910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:16.860073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:16.860688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:16.860965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:16.861238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:16.862973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 328/672] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:16.863634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.869162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:16.870606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:16.882077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:16.883241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 345/673] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:16.884347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:16.968329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ac3c1-0776-4d20-87d2-68a7c308dcf3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:16.983611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf053-340b-4330-80a6-dffcecf9b0dd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.000886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867ce2-8d1c-40ae-8c58-af03163d1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.001529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867ce2-8d1c-40ae-8c58-af03163d1af0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.001805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867ce2-8d1c-40ae-8c58-af03163d1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.002076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867ce2-8d1c-40ae-8c58-af03163d1af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.009225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867ce2-8d1c-40ae-8c58-af03163d1af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.010643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867ce2-8d1c-40ae-8c58-af03163d1af0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.016300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.016886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.017157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.017420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.018089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:17.018414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.019828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-af867ce2-8d1c-40ae-8c58-af03163d1af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:17.021585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:17.022890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 329/674] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:17.023864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d99cc3-e9d9-44ea-bca0-1304abba293b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.024417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d99cc3-e9d9-44ea-bca0-1304abba293b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.024417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d99cc3-e9d9-44ea-bca0-1304abba293b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.025738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 330/675] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:17.026276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d99cc3-e9d9-44ea-bca0-1304abba293b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.033946 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 346/676] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:17.034652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.072827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:17.073965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:17.132757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d99cc3-e9d9-44ea-bca0-1304abba293b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.135004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb4798-743c-4bb1-8139-5be527a98758 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.167274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872b42d-1de5-4127-b634-bdb16cfa8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.167898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b42d-1de5-4127-b634-bdb16cfa8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.168177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b42d-1de5-4127-b634-bdb16cfa8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.168451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b42d-1de5-4127-b634-bdb16cfa8bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.171198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.171785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.172058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.172323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.172992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:17.173291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.174715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.178838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872b42d-1de5-4127-b634-bdb16cfa8bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.180282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872b42d-1de5-4127-b634-bdb16cfa8bd3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.185883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 347/677] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:17.186662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a872b42d-1de5-4127-b634-bdb16cfa8bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:17.195092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:17.196220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:17.197348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:17.197348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:17.197348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:17.197348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 331/678] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:17.197656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284d45-3038-4c5a-a018-a150c0a1b9bc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.197943 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284d45-3038-4c5a-a018-a150c0a1b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.198270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284d45-3038-4c5a-a018-a150c0a1b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.216471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-67284d45-3038-4c5a-a018-a150c0a1b9bc None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:17.217662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-67284d45-3038-4c5a-a018-a150c0a1b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:17.284220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 332/679] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:17.285143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67284d45-3038-4c5a-a018-a150c0a1b9bc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.286124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:17.296616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340642b-cc39-4e1d-900c-8be66454ef93 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.314166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:17.336588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.337199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.337460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.337724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.338402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:17.338704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.340143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.356996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 348/680] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:17.356996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.396824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67284d45-3038-4c5a-a018-a150c0a1b9bc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.439639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.440493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.440766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.441030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.441741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=ac3f250eacf044f1b760f3b75d4ba33a) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:17.442043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.443609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.458784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 333/681] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/role_assignments?user.id=ac3f250eacf044f1b760f3b75d4ba33a&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:17.458784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.470948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0c34d-3551-489c-953a-0e8cc3e86cda None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.516264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.517410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.517695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.518248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.519261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=f50dc809ff034866a1f6343e5b32609b) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:17.519759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.521611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.531405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 349/682] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/role_assignments?user.id=f50dc809ff034866a1f6343e5b32609b&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:17.532354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.578403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:17.581133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:17.596946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c845e-dfce-40da-85e1-00316b10f8e4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.640856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.641478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.641816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.642082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.642834 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:17.643141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.647889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.669802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 334/683] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:17.670683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.699084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a29924-4789-49de-b0f7-fb0516aacd0f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.748044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.749277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.749277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.749449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.750112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=3b877cb99245408b8ca37c9e85eb023e) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:17.750418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.751868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.760132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 350/684] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/role_assignments?user.id=3b877cb99245408b8ca37c9e85eb023e&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:17.760950 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.805641 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b1f8-b6ad-4d20-83e9-dab55aceb7d6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.845193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.846236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.846719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.847229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.860062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.862428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.868571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:17.872363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:17.882979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:17.884158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:17.885051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:17.885051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:17.885051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:17.886795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 335/685] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:17.892121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39773f-260c-466b-96a8-183a9debf822 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:17.895801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:17.959647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:17.961430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:17.963168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:17.963436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:17.979658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:17.982327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:17.999519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:18.000934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:18.001864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:18.006176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 351/686] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:18.009033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:18.071825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc82f98-d2f2-4324-ae41-9035acc55485 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:18.120378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:18.120910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:18.121186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:18.121454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:18.122203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:18.122511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:18.124246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:18.129733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bf7bc-4294-47ae-95e0-594dc750dee1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:18.138213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 336/687] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:18.143633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:18.184804 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:18.185777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:18.186063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:18.186380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:18.187151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:18.187705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:18.190223 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:18.218844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 352/688] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Sep 24 04:48:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:18.221896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:18.222010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:18.239099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:18.276660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033b634-6a3d-4305-bdac-67d9b39cf6b0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:18.323265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488b2dc-c71a-4159-9589-103b97cc1910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:18.324227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b2dc-c71a-4159-9589-103b97cc1910 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:18.324520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b2dc-c71a-4159-9589-103b97cc1910 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:18.324794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b2dc-c71a-4159-9589-103b97cc1910 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:18.325761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488b2dc-c71a-4159-9589-103b97cc1910 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:18.327502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488b2dc-c71a-4159-9589-103b97cc1910 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:18.355028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab51529-9026-4e1d-b5d3-08ed4e527abe None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:18.358860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 337/689] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:48:18 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:48:18.400983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e89e76-4f47-4b68-b190-3a81393317d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:18.401686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89e76-4f47-4b68-b190-3a81393317d4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:18.402113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89e76-4f47-4b68-b190-3a81393317d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:18.402464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89e76-4f47-4b68-b190-3a81393317d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:18.498981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e89e76-4f47-4b68-b190-3a81393317d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:18.500614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e89e76-4f47-4b68-b190-3a81393317d4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:18.514666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:18.622866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 353/690] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:18.625271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488b2dc-c71a-4159-9589-103b97cc1910 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:18.741691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488b2dc-c71a-4159-9589-103b97cc1910 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:18.755701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:18.779169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:18.779798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:18.780073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:18.780338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:18.791630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:18.793056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:18.807360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:18.808347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:18.809234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:18.809234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:18.809234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:18.813025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 338/691] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:18.814385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e89e76-4f47-4b68-b190-3a81393317d4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:18.919095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e89e76-4f47-4b68-b190-3a81393317d4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:18.921488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:18.955813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:18.956424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:18.956705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:18.956976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:18.957614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:18.957918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:18.959311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:18.976280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 354/692] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:18.977651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:19.122540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecea74-dc6e-49af-ab9d-d89b8b2a7995 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:19.171596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:19.172141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:19.172419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:19.172678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:19.183859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:19.185295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:19.199406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:19.200334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:19.201234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 339/693] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:19.206344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:19.335169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeac10-32f1-4373-96a7-1d1ac42bf788 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:19.375779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438edaa-e7be-4e80-8639-8b32963bd51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:19.376390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438edaa-e7be-4e80-8639-8b32963bd51c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:19.376726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438edaa-e7be-4e80-8639-8b32963bd51c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:19.377001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438edaa-e7be-4e80-8639-8b32963bd51c None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:19.377689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438edaa-e7be-4e80-8639-8b32963bd51c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:19.377990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438edaa-e7be-4e80-8639-8b32963bd51c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:19.379453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438edaa-e7be-4e80-8639-8b32963bd51c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:19.398581 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 355/694] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:19.404622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:19.466282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:19.551338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b6804-e3c1-4766-b4ad-57958e2d3f68 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:19.587412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbab6e-498d-4933-8a0a-755799c7aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:19.588024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbab6e-498d-4933-8a0a-755799c7aceb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:19.588303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbab6e-498d-4933-8a0a-755799c7aceb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:19.588626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbab6e-498d-4933-8a0a-755799c7aceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:19.589404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbab6e-498d-4933-8a0a-755799c7aceb None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=473bfd2bae82474e81232a3bb364e5bc) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:19.589720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbab6e-498d-4933-8a0a-755799c7aceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:19.591166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbab6e-498d-4933-8a0a-755799c7aceb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:19.597619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 340/695] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:19 2022] GET /identity/v3/role_assignments?user.id=473bfd2bae82474e81232a3bb364e5bc&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:20.036282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fad01-1880-43c0-b2b4-280e474d1ece None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:20.037315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fad01-1880-43c0-b2b4-280e474d1ece None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:20.038363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fad01-1880-43c0-b2b4-280e474d1ece None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:20.040210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 356/696] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:20.045665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612e8f-70e0-42ba-a5e7-06e11f7a86f2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:20.046186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612e8f-70e0-42ba-a5e7-06e11f7a86f2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:20.046655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612e8f-70e0-42ba-a5e7-06e11f7a86f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:20.066361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-42612e8f-70e0-42ba-a5e7-06e11f7a86f2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:20.067979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42612e8f-70e0-42ba-a5e7-06e11f7a86f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:20.150917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 341/697] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:20.197891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a564ef-1202-4508-bfcb-68189cf5d156 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:20.198198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a564ef-1202-4508-bfcb-68189cf5d156 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:20.198430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a564ef-1202-4508-bfcb-68189cf5d156 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:20.200088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 357/698] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:20.205523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53cb4f-74c0-41b5-b3c9-b5ef5331a3da None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:20.205811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53cb4f-74c0-41b5-b3c9-b5ef5331a3da None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:20.206089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53cb4f-74c0-41b5-b3c9-b5ef5331a3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:20.226106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cc53cb4f-74c0-41b5-b3c9-b5ef5331a3da None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:20.228295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cc53cb4f-74c0-41b5-b3c9-b5ef5331a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:20.243975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:20.309878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 342/699] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:20.447010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a564ef-1202-4508-bfcb-68189cf5d156 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:20.473836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:20.569782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a564ef-1202-4508-bfcb-68189cf5d156 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:20.613762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:20.614395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:20.614668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:20.614955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] PATH_INFO: `/v3/services/network` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:20.615532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:20.617802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:20.632332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:20.633518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:20.634346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 358/700] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:20 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:20.639593 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53cb4f-74c0-41b5-b3c9-b5ef5331a3da None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:20.734335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:20.795880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53cb4f-74c0-41b5-b3c9-b5ef5331a3da None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:20.849480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:20.850296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:20.851134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:20.851410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:20.852036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:20.852342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:20.853796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:20.862862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 343/701] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:20.864571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:20.884036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:20.899496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:20.912383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a9bfc-4154-4595-87b7-a2bc1d592727 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:20.954733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d0be8-bc79-46c1-bf2f-77f87bf0f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:20.955655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d0be8-bc79-46c1-bf2f-77f87bf0f042 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:20.956113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d0be8-bc79-46c1-bf2f-77f87bf0f042 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:20.956565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d0be8-bc79-46c1-bf2f-77f87bf0f042 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:20.957548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d0be8-bc79-46c1-bf2f-77f87bf0f042 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:20.959541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d0be8-bc79-46c1-bf2f-77f87bf0f042 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-0d7d0be8-bc79-46c1-bf2f-77f87bf0f042 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:20.969388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:20.970442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:20.971936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:20.976190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 359/702] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Sep 24 04:48:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:20.977590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501bdc-2e05-498c-bcd0-f797beb49333 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:20.977874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501bdc-2e05-498c-bcd0-f797beb49333 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:20.978202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501bdc-2e05-498c-bcd0-f797beb49333 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:20.979952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 360/703] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:20.980803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f501bdc-2e05-498c-bcd0-f797beb49333 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:20.991120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfa321-06aa-4ec6-9476-ee7085c66409 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:21.030798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2619e-c6c0-4c53-8ffd-e240f2a96f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:21.031774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2619e-c6c0-4c53-8ffd-e240f2a96f2f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:21.032251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2619e-c6c0-4c53-8ffd-e240f2a96f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:21.032822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2619e-c6c0-4c53-8ffd-e240f2a96f2f None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:21.033658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2619e-c6c0-4c53-8ffd-e240f2a96f2f None admin] RBAC: Adding query filter params (type=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:21.034345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2619e-c6c0-4c53-8ffd-e240f2a96f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:21.035921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2619e-c6c0-4c53-8ffd-e240f2a96f2f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:21.050976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 344/704] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:21.055858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c246-39f8-436e-b6a5-08eb08f80a63 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:21.056935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c246-39f8-436e-b6a5-08eb08f80a63 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:21.057966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c246-39f8-436e-b6a5-08eb08f80a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:21.099399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1954c246-39f8-436e-b6a5-08eb08f80a63 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:21.100728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1954c246-39f8-436e-b6a5-08eb08f80a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:21.150710 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f501bdc-2e05-498c-bcd0-f797beb49333 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:21.223967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:21.224585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:21.224862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:21.226658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:21.227577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:21.227883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:21.230217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:21.239121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 361/705] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 24 04:48:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:21.246925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:21.257584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 345/706] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:21.274160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:21.368882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f6100-119e-4607-8a9c-89b05d17cb64 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:21.404016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e49e7-a30f-469d-a040-5a3dd1d3b6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:21.404619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e49e7-a30f-469d-a040-5a3dd1d3b6bd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:21.404893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e49e7-a30f-469d-a040-5a3dd1d3b6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:21.405161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e49e7-a30f-469d-a040-5a3dd1d3b6bd None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:21.405783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e49e7-a30f-469d-a040-5a3dd1d3b6bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:21.406082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e49e7-a30f-469d-a040-5a3dd1d3b6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:21.407480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e49e7-a30f-469d-a040-5a3dd1d3b6bd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:21.413598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 362/707] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 24 04:48:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:21.443715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3af4e-146a-4add-a275-aa4fe7ff6d79 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:21.443715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3af4e-146a-4add-a275-aa4fe7ff6d79 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:21.443715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3af4e-146a-4add-a275-aa4fe7ff6d79 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:21.445791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 346/708] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:21.450451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41d3a-8a14-4384-886e-40ea35673f14 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:21.450863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41d3a-8a14-4384-886e-40ea35673f14 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:21.451144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41d3a-8a14-4384-886e-40ea35673f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:21.471785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-43a41d3a-8a14-4384-886e-40ea35673f14 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:21.472976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-43a41d3a-8a14-4384-886e-40ea35673f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:21.552246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 363/709] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:21.593338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3af4e-146a-4add-a275-aa4fe7ff6d79 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:21.605666 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:21.727468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3af4e-146a-4add-a275-aa4fe7ff6d79 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:21.772851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48f5b-dc50-45b3-90eb-a66f8d63a8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:21.773589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48f5b-dc50-45b3-90eb-a66f8d63a8cb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:21.773866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48f5b-dc50-45b3-90eb-a66f8d63a8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:21.774136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48f5b-dc50-45b3-90eb-a66f8d63a8cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:21.790644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48f5b-dc50-45b3-90eb-a66f8d63a8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-60f48f5b-dc50-45b3-90eb-a66f8d63a8cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:21.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:21.796604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:21.797447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 347/710] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:21.802979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a41d3a-8a14-4384-886e-40ea35673f14 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:21.816571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:21.903032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48f5b-dc50-45b3-90eb-a66f8d63a8cb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:21.911711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a41d3a-8a14-4384-886e-40ea35673f14 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:21.949983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:21.949983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:21.949983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:21.949983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:21.950407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:21.950407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:21.950543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:21.959320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 364/711] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:21.966333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:22.047129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:22.111241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48f5b-dc50-45b3-90eb-a66f8d63a8cb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:22.119131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:22.152312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f2bf3-8de4-447a-899c-5d3e961b965b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:22.184927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e5642-2bd7-41be-8efa-d6df9dcb0c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:22.185481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5642-2bd7-41be-8efa-d6df9dcb0c5e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.185758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5642-2bd7-41be-8efa-d6df9dcb0c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.186026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5642-2bd7-41be-8efa-d6df9dcb0c5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.188744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:22.189492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.189864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.190230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.201772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:22.203403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:22.208065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e5642-2bd7-41be-8efa-d6df9dcb0c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7c2e5642-2bd7-41be-8efa-d6df9dcb0c5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:22.213600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:22.214514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:22.215365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 348/712] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:22.221196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e5642-2bd7-41be-8efa-d6df9dcb0c5e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:22.223765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:22.225934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:22.227962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:22.227962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:22.227962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:22.227962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 365/713] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:22.231621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:22.400309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47440be1-22e2-4bf5-9d26-a4145228d466 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:22.424226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:22.428075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e5642-2bd7-41be-8efa-d6df9dcb0c5e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:22.443489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:22.444565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.444995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.445247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.446100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:22.446404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:22.447796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:22.469851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 366/714] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:22.476131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:22.482121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:22.506845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:22.508051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.508529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.510725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.511752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:22.512357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:22.513963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:22.530196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 349/715] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:22.532239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:22.671320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad79f7-8dea-46ac-9dfc-75325fef814c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:22.702498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fd894-9efa-4c0e-af79-0334073227b5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:22.709139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05fa57-85a1-4c07-b228-bd2f8362b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:22.710696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05fa57-85a1-4c07-b228-bd2f8362b8cb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.711156 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05fa57-85a1-4c07-b228-bd2f8362b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.711665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05fa57-85a1-4c07-b228-bd2f8362b8cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.719862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05fa57-85a1-4c07-b228-bd2f8362b8cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:22.721604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05fa57-85a1-4c07-b228-bd2f8362b8cb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-ff05fa57-85a1-4c07-b228-bd2f8362b8cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:22.735422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:22.736642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:22.737725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:22.742931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f08b5b-4413-4184-a1d0-5ee7a483b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:22.744170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f08b5b-4413-4184-a1d0-5ee7a483b702 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.744595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f08b5b-4413-4184-a1d0-5ee7a483b702 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.745005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 367/716] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:48:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:22.745294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f08b5b-4413-4184-a1d0-5ee7a483b702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.746445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c828f1-d184-4123-baf1-31809fa05e43 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.746731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c828f1-d184-4123-baf1-31809fa05e43 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.747034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c828f1-d184-4123-baf1-31809fa05e43 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.749404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 368/717] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:22.750291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c828f1-d184-4123-baf1-31809fa05e43 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:22.762686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f08b5b-4413-4184-a1d0-5ee7a483b702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:22.764431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f08b5b-4413-4184-a1d0-5ee7a483b702 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-52f08b5b-4413-4184-a1d0-5ee7a483b702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:22.780911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:22.782135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:22.783322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:22.783322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:22.783322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:22.788910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 350/718] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:22.788910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d725fc8-418e-4ed2-8804-bf663bfc6e70 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.788910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d725fc8-418e-4ed2-8804-bf663bfc6e70 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.788910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d725fc8-418e-4ed2-8804-bf663bfc6e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.806368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2d725fc8-418e-4ed2-8804-bf663bfc6e70 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:22.807702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d725fc8-418e-4ed2-8804-bf663bfc6e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:22.815093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:22.848842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:22.885924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c828f1-d184-4123-baf1-31809fa05e43 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:22.893232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 351/719] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:22.894281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d725fc8-418e-4ed2-8804-bf663bfc6e70 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:22.923640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:22.924536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:22.925385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:22.925872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:22.926912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:22.927406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:22.929697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:22.955758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 369/720] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:48:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:22.957335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:23.064077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d725fc8-418e-4ed2-8804-bf663bfc6e70 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.102937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.103853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.104309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.104778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.105594 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:23.106504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:23.108084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:23.121927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 352/721] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:23.127316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:23.163383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:23.199813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db25a-24c7-428e-8cf2-11e983c8f1b5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.201622 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:23.244440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2603b4-1aad-4d3c-98af-0b206a6bbef7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.255427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a92b0-5ad0-4043-a1b2-2f0081131caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.256199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a92b0-5ad0-4043-a1b2-2f0081131caf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.257063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a92b0-5ad0-4043-a1b2-2f0081131caf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.257409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a92b0-5ad0-4043-a1b2-2f0081131caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.284341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.285289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.285745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.286190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.297140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:23.298866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:23.312180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:23.313121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:23.314064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:23.316686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 353/722] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:48:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:23.317663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:23.340338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a92b0-5ad0-4043-a1b2-2f0081131caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:23.341798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a92b0-5ad0-4043-a1b2-2f0081131caf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:23.425782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:23.436816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c918d-5d88-4104-ac62-b3c011663cb1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.455619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 370/723] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:23.455619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a92b0-5ad0-4043-a1b2-2f0081131caf None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:23.456297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:23.490085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572b354-7c31-4cfa-a004-5ac99eb66939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.491808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b354-7c31-4cfa-a004-5ac99eb66939 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.492333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b354-7c31-4cfa-a004-5ac99eb66939 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.492805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b354-7c31-4cfa-a004-5ac99eb66939 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.505573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572b354-7c31-4cfa-a004-5ac99eb66939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2572b354-7c31-4cfa-a004-5ac99eb66939 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:23.512144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:23.513153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:23.514092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:23.521713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 354/724] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:23.521713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572b354-7c31-4cfa-a004-5ac99eb66939 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:23.571142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a92b0-5ad0-4043-a1b2-2f0081131caf None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.607557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.608423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.608721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.608992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.609730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:23.610075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:23.612507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:23.639951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 371/725] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Sep 24 04:48:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:23.640868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:23.653587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572b354-7c31-4cfa-a004-5ac99eb66939 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.695310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150c0b1-e3ff-43d6-8989-7733f52a1083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.696181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c0b1-e3ff-43d6-8989-7733f52a1083 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.696684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c0b1-e3ff-43d6-8989-7733f52a1083 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.697120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c0b1-e3ff-43d6-8989-7733f52a1083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.705393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:23.710506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c0b1-e3ff-43d6-8989-7733f52a1083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:23.712437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c0b1-e3ff-43d6-8989-7733f52a1083 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0150c0b1-e3ff-43d6-8989-7733f52a1083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:23.728898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:23.730098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:23.731246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:23.731246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:23.731246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:23.733612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 355/726] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:23.735085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955289a4-0d46-4a53-ad73-615c2ff36739 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.735365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955289a4-0d46-4a53-ad73-615c2ff36739 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.735637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955289a4-0d46-4a53-ad73-615c2ff36739 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.738799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 356/727] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:23.738799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955289a4-0d46-4a53-ad73-615c2ff36739 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:23.742444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:23.758839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7220883-7be4-403a-99ea-8a5d620e82c0 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.795955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.796561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.796839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.797109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.798248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:23.798566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:23.800005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:23.808501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 372/728] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:23.809314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:23.854623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955289a4-0d46-4a53-ad73-615c2ff36739 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.891277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b019248-6018-49bb-9f48-f6b0e0faf9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.891892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b019248-6018-49bb-9f48-f6b0e0faf9ca None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.892246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b019248-6018-49bb-9f48-f6b0e0faf9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.892514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b019248-6018-49bb-9f48-f6b0e0faf9ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.910339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d575bd8-91a4-44f5-b68f-d4d87de62631 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:23.935333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:23.947770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145280ba-87a0-4161-ba83-f19fc5a32412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:23.948373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145280ba-87a0-4161-ba83-f19fc5a32412 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.948709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145280ba-87a0-4161-ba83-f19fc5a32412 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.948981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145280ba-87a0-4161-ba83-f19fc5a32412 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.949714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145280ba-87a0-4161-ba83-f19fc5a32412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:23.949971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145280ba-87a0-4161-ba83-f19fc5a32412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:23.951373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145280ba-87a0-4161-ba83-f19fc5a32412 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:23.968689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 373/729] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:23.970282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a919495-f250-4078-8934-6223ed277ba4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:23.970659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a919495-f250-4078-8934-6223ed277ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:23.971027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a919495-f250-4078-8934-6223ed277ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:23.972410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b019248-6018-49bb-9f48-f6b0e0faf9ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:23.973873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b019248-6018-49bb-9f48-f6b0e0faf9ca None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:23.978677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:23.990682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3a919495-f250-4078-8934-6223ed277ba4 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:23.992503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3a919495-f250-4078-8934-6223ed277ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:24.061565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 374/730] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:24.062404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a919495-f250-4078-8934-6223ed277ba4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.094856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 357/731] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 04:48:24.096091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b019248-6018-49bb-9f48-f6b0e0faf9ca None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.171500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a919495-f250-4078-8934-6223ed277ba4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.187002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:24.201683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b019248-6018-49bb-9f48-f6b0e0faf9ca None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.204991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:24.209554 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a48a7-caf8-4a68-a9d3-9d5abc26dc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.210943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a48a7-caf8-4a68-a9d3-9d5abc26dc88 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.211201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a48a7-caf8-4a68-a9d3-9d5abc26dc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.211473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a48a7-caf8-4a68-a9d3-9d5abc26dc88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.223505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a48a7-caf8-4a68-a9d3-9d5abc26dc88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.224944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a48a7-caf8-4a68-a9d3-9d5abc26dc88 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-4f2a48a7-caf8-4a68-a9d3-9d5abc26dc88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:24.239113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:24.240043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:24.241439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:24.241439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:24.241439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:24.241439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 375/732] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:24.241809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc458d-d20a-4e26-9d9b-76c3a380eaea None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.242587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc458d-d20a-4e26-9d9b-76c3a380eaea None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.242587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc458d-d20a-4e26-9d9b-76c3a380eaea None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.243731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 376/733] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:24.246178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.247203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.247203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.247643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.248476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc458d-d20a-4e26-9d9b-76c3a380eaea None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.256096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.258238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:24.272910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:24.273775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:24.274659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 358/734] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:24.276293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.366846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc458d-d20a-4e26-9d9b-76c3a380eaea None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.377800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c042c9-3f0a-4b1a-8b4b-20fe6246eaed None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.400430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.401244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.401521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.401791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.411480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7d093-928a-45bb-961b-cc9c79554551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.411758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.412071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d093-928a-45bb-961b-cc9c79554551 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.412341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d093-928a-45bb-961b-cc9c79554551 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.412608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d093-928a-45bb-961b-cc9c79554551 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.413763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.414105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7d093-928a-45bb-961b-cc9c79554551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:24.414402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7d093-928a-45bb-961b-cc9c79554551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.415788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7d093-928a-45bb-961b-cc9c79554551 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.427001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 359/735] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:24.427961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:24.433567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:24.434556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:24.434556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:24.434556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:24.434731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349a96-526d-4b9b-b783-ebdf7e7f30a3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.434731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349a96-526d-4b9b-b783-ebdf7e7f30a3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.434731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349a96-526d-4b9b-b783-ebdf7e7f30a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.434978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 377/736] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:24.434978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.451074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-16349a96-526d-4b9b-b783-ebdf7e7f30a3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:24.451246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:24.452254 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-16349a96-526d-4b9b-b783-ebdf7e7f30a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:24.469695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:24.518827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 360/737] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 04:48:24.519709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349a96-526d-4b9b-b783-ebdf7e7f30a3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.544520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf47377-38bc-4791-b409-3dc51cdaa11d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.580095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.580714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.580977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.581215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.582034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:24.582296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.583926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.598917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 378/738] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:24.600031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.626094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349a96-526d-4b9b-b783-ebdf7e7f30a3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.670626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913815f4-f689-43bf-9786-0ee83090c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913815f4-f689-43bf-9786-0ee83090c32b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.671842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913815f4-f689-43bf-9786-0ee83090c32b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.672111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913815f4-f689-43bf-9786-0ee83090c32b None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.672758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913815f4-f689-43bf-9786-0ee83090c32b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.674942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913815f4-f689-43bf-9786-0ee83090c32b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.685889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:24.692357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 361/739] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:48:24 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:24.693156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913815f4-f689-43bf-9786-0ee83090c32b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.711987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:24.735480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e846-72f5-4d59-950a-36a3c1cb38d5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.781534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.782095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.782375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.782740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.792208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.793838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:24.809105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:24.810144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 379/740] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:24.811535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.825878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913815f4-f689-43bf-9786-0ee83090c32b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.862994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.863660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.863902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.864134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.864839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:24.865195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.867335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.880650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 362/741] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:24.881502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.926494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83436d-6490-4629-94af-3e46bc178677 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:24.957998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:24.960960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:24.964864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:24.965456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:24.965730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:24.965997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:24.966716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=3b877cb99245408b8ca37c9e85eb023e) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:24.967045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:24.968455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:24.973865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 380/742] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/role_assignments?user.id=3b877cb99245408b8ca37c9e85eb023e&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:24.974635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:24.999725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647e86-fa4e-46ff-8883-2edc59db9285 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:25.043607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d49d-a043-4967-8589-6946f8fee872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:25.044492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d49d-a043-4967-8589-6946f8fee872 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:25.044940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d49d-a043-4967-8589-6946f8fee872 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:25.045371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d49d-a043-4967-8589-6946f8fee872 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:25.046398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21d49d-a043-4967-8589-6946f8fee872 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:25.048828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21d49d-a043-4967-8589-6946f8fee872 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:25.067652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 363/743] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:48:24 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:25.069230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d49d-a043-4967-8589-6946f8fee872 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:25.117455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50205cae-95bf-459e-aa82-64acccee49f3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:25.166468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:25.167131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:25.167474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:25.167806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:25.168623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:25.168998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:25.170597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:25.200005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 381/744] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Sep 24 04:48:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:25.207672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:25.228781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d49d-a043-4967-8589-6946f8fee872 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:25.299177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:25.299827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:25.300099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:25.300364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:25.302518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:25.309346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:25.311278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:25.312329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:25.329948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:25.330941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:25.332235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 364/745] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:25.337074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:25.380112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a5a25-c2d5-49b9-8439-6cd43ae42307 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:25.416973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b74e9-7ced-4f19-bdcd-fa6a470f3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:25.417868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b74e9-7ced-4f19-bdcd-fa6a470f3a24 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:25.418323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b74e9-7ced-4f19-bdcd-fa6a470f3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:25.418787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b74e9-7ced-4f19-bdcd-fa6a470f3a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:25.456283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf83e-47bd-47f7-9658-011cb814a18b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:25.494159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:25.494903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:25.495268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:25.495881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:25.496409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:25.496781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:25.498554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:25.508476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b74e9-7ced-4f19-bdcd-fa6a470f3a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:25.511055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b74e9-7ced-4f19-bdcd-fa6a470f3a24 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:25.514072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 365/746] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:25.520394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:25.636764 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:25.718250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1820f-ac72-42dc-9326-615093c0fe91 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:25.720067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:25.775488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:25.776446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:25.776918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:25.777377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:25.778314 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=58adf938f17647108c2d652565bf3e2b) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:25.780240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:25.781897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:25.795703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 366/747] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:25 2022] GET /identity/v3/role_assignments?user.id=58adf938f17647108c2d652565bf3e2b&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:25.808199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 382/748] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 04:48:25.816000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:25.951205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996987a7-b1d4-467e-812c-17c0c26a5824 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:25.986340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:26.010116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:26.010770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:26.011050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:26.011320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:26.023896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:26.025335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:26.039657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:26.040628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:26.041521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:26.041521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:26.041521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:26.041521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 367/749] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:26.046335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b74e9-7ced-4f19-bdcd-fa6a470f3a24 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:26.174597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b74e9-7ced-4f19-bdcd-fa6a470f3a24 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:26.215712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:26.216316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:26.216593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:26.216864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:26.217506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:26.217808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:26.219200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:26.237263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 383/750] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:26.242790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:26.408319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764cb1a-1b55-415a-94d0-a4eaa3054ceb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:26.452530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:26.453547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:26.454023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:26.454502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:26.468205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:26.469927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:26.489387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:26.490278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:26.491971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:26.491971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:26.491971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:26.491971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:26.491971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:26.491971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:26.491971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:26.491971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:26.494045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 368/751] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:26.503829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:26.526226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:26.646277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947776b-a87e-4fcd-a1d7-3dc0b4a85571 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:26.695318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d009-0848-4ffc-9e5c-12e976562e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:26.695927 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d009-0848-4ffc-9e5c-12e976562e64 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:26.696201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d009-0848-4ffc-9e5c-12e976562e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:26.696467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d009-0848-4ffc-9e5c-12e976562e64 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:26.697207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d009-0848-4ffc-9e5c-12e976562e64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:26.697517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d009-0848-4ffc-9e5c-12e976562e64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:26.698965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d009-0848-4ffc-9e5c-12e976562e64 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:26.714613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 384/752] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:26.720342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:26.761975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:26.847089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382cb45-8f06-480a-a95e-2e1d3f698153 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:26.886481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ec7ab-4499-4dff-9703-7fdfd40d4317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:26.887243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ec7ab-4499-4dff-9703-7fdfd40d4317 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:26.887513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ec7ab-4499-4dff-9703-7fdfd40d4317 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:26.887782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ec7ab-4499-4dff-9703-7fdfd40d4317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:26.888504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ec7ab-4499-4dff-9703-7fdfd40d4317 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=473bfd2bae82474e81232a3bb364e5bc) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:26.888812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ec7ab-4499-4dff-9703-7fdfd40d4317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:26.890221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ec7ab-4499-4dff-9703-7fdfd40d4317 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:26.896067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 369/753] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:26 2022] GET /identity/v3/role_assignments?user.id=473bfd2bae82474e81232a3bb364e5bc&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:27.286736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7524fe-b551-4b86-a4d8-f2f396565f50 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:27.287046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7524fe-b551-4b86-a4d8-f2f396565f50 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:27.287314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7524fe-b551-4b86-a4d8-f2f396565f50 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:27.289025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 385/754] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:27.294452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da99df-5ac9-4a4e-acad-dac04c8cd635 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:27.294969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da99df-5ac9-4a4e-acad-dac04c8cd635 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:27.295046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da99df-5ac9-4a4e-acad-dac04c8cd635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:27.320470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f7da99df-5ac9-4a4e-acad-dac04c8cd635 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:27.321681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f7da99df-5ac9-4a4e-acad-dac04c8cd635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:27.413396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 370/755] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:27.505114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe9ee-a6bb-4f24-8867-32dfbec8feef None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:27.505629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe9ee-a6bb-4f24-8867-32dfbec8feef None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:27.505629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe9ee-a6bb-4f24-8867-32dfbec8feef None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:27.507802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 386/756] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:27.513024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d16c9-c30f-4837-812a-58ea0574fdd5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:27.513309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d16c9-c30f-4837-812a-58ea0574fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:27.513580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d16c9-c30f-4837-812a-58ea0574fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:27.539828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a46d16c9-c30f-4837-812a-58ea0574fdd5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:27.541009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a46d16c9-c30f-4837-812a-58ea0574fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:27.561285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:27.627702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 371/757] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:27.727647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe9ee-a6bb-4f24-8867-32dfbec8feef None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:27.802039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:27.846159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe9ee-a6bb-4f24-8867-32dfbec8feef None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:27.891362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:27.891989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:27.892265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:27.892593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] PATH_INFO: `/v3/services/network` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:27.893170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:27.894695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:27.904745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:27.905873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:27.906694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:27.909270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 387/758] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:27 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:27.912211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d16c9-c30f-4837-812a-58ea0574fdd5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.017514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d16c9-c30f-4837-812a-58ea0574fdd5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:28.038845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.054610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:28.055142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.055422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.055693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.056331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:28.056633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:28.057998 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:28.062992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 372/759] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:28.076916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.123103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:28.183392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99060ce0-e8bb-4caa-8b91-04e2efe1f141 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:28.227341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e23cb3-0f66-442f-9247-de691e0f5a81 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:28.266456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:28.267118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.267393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.268032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.268809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] RBAC: Adding query filter params (type=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:28.269119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:28.270585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:28.281707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 373/760] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:28.283855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.287577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8e07-d90a-4113-aa15-8fef9334271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:28.288925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8e07-d90a-4113-aa15-8fef9334271c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.289067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8e07-d90a-4113-aa15-8fef9334271c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.289400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8e07-d90a-4113-aa15-8fef9334271c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.300312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:28.339573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a8e07-d90a-4113-aa15-8fef9334271c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d05a8e07-d90a-4113-aa15-8fef9334271c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:28.344735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:28.345653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:28.346483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 388/761] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:28.355790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8e07-d90a-4113-aa15-8fef9334271c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.379173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:28.392212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1df41c-f03c-4a6d-abb4-bcf01239df0a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:28.432853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80457197-e995-49e8-a8fb-b474399a55ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:28.433556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80457197-e995-49e8-a8fb-b474399a55ce None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.433838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80457197-e995-49e8-a8fb-b474399a55ce None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.434234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80457197-e995-49e8-a8fb-b474399a55ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.434986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80457197-e995-49e8-a8fb-b474399a55ce None admin] RBAC: Adding query filter params (interface=public, service_id=9345bd6a81dc47f6a204af52d645fef8, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:28.435301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80457197-e995-49e8-a8fb-b474399a55ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:28.436651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80457197-e995-49e8-a8fb-b474399a55ce None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:28.452662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 374/762] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 24 04:48:28 2022] GET /identity/v3/endpoints?service_id=9345bd6a81dc47f6a204af52d645fef8&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:28.454294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d64b-552e-4c27-a903-a0a44959c804 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.455091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d64b-552e-4c27-a903-a0a44959c804 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.455400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d64b-552e-4c27-a903-a0a44959c804 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.456703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 375/763] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:28.457409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d64b-552e-4c27-a903-a0a44959c804 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.489258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8e07-d90a-4113-aa15-8fef9334271c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:28.526134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f278ed-b4fb-4981-af61-9f906def87de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:28.526794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f278ed-b4fb-4981-af61-9f906def87de None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.527162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f278ed-b4fb-4981-af61-9f906def87de None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.527436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f278ed-b4fb-4981-af61-9f906def87de None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.528104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f278ed-b4fb-4981-af61-9f906def87de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:28.528409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f278ed-b4fb-4981-af61-9f906def87de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:28.529779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f278ed-b4fb-4981-af61-9f906def87de None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:28.540886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 389/764] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:28.547044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0cd1-0189-4e18-99c8-63d894594f5c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.547373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0cd1-0189-4e18-99c8-63d894594f5c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.547606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc0cd1-0189-4e18-99c8-63d894594f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.567877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-39fc0cd1-0189-4e18-99c8-63d894594f5c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:28.569840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-39fc0cd1-0189-4e18-99c8-63d894594f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:28.589885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d64b-552e-4c27-a903-a0a44959c804 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:28.625394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:28.628084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2363f-504d-4517-ac79-53b0d9f3e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:28.628690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2363f-504d-4517-ac79-53b0d9f3e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.629553 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2363f-504d-4517-ac79-53b0d9f3e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.629828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2363f-504d-4517-ac79-53b0d9f3e7d6 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.630433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2363f-504d-4517-ac79-53b0d9f3e7d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:28.633057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2363f-504d-4517-ac79-53b0d9f3e7d6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:28.639864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 376/765] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:48:28 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:28.640691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2363f-504d-4517-ac79-53b0d9f3e7d6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.654801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 390/766] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:28.667812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:28.696647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e836-6b44-43bf-abe6-8dc0b783d4f7 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.697140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e836-6b44-43bf-abe6-8dc0b783d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.697513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e836-6b44-43bf-abe6-8dc0b783d4f7 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.699368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 391/767] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:28.716468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d25c5-ffb4-4c76-b11b-c96f97cf5293 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.717117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d25c5-ffb4-4c76-b11b-c96f97cf5293 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.717591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d25c5-ffb4-4c76-b11b-c96f97cf5293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.763993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-625d25c5-ffb4-4c76-b11b-c96f97cf5293 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:28.765681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-625d25c5-ffb4-4c76-b11b-c96f97cf5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:28.777096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2363f-504d-4517-ac79-53b0d9f3e7d6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:28.813832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:28.814881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:28.815353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:28.815835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:28.827572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:28.829390 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:28.845449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:28.846419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:28.847342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:28.847342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:28.847342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:28.849486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 377/768] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:28.855460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.924843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 392/769] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:28.948391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:28.957597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d25c5-ffb4-4c76-b11b-c96f97cf5293 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:28.992109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde36b93-d024-49ce-92b9-10569ca400c6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.028598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.029491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.029924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.030332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.031152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:29.031609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.033087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.046212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 378/770] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:29.052887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.096013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d25c5-ffb4-4c76-b11b-c96f97cf5293 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.128227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:29.160121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0d126-7670-42b5-9937-4bd211c2f07e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.187846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:29.188175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.188832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.189103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.189372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.189964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.191394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.201857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.202512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.202805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.203074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.210703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.212169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:29.212475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:29.213429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:29.214274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:29.219178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 393/771] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Sep 24 04:48:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:29.229646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:29.229938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:29.230859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:29.231796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 379/772] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:29.232375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.339512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7ffa-050e-49f4-9f6c-3a23eaf4bf22 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.341311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fabe4-750f-4566-addb-64e3f200e783 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.382180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.382707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9e72-48b6-487d-b16b-b41c13ec79e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.382835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9e72-48b6-487d-b16b-b41c13ec79e1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.383091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9e72-48b6-487d-b16b-b41c13ec79e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.383308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9e72-48b6-487d-b16b-b41c13ec79e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.384085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.384550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.385287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.386566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:29.387103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.388952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.393948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed9e72-48b6-487d-b16b-b41c13ec79e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:29.395269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 380/773] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:29.396267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d2ed9e72-48b6-487d-b16b-b41c13ec79e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:29.403115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:29.404022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:29.404870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:29.413395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 394/774] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:29.414569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9e72-48b6-487d-b16b-b41c13ec79e1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.453508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:29.474530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:29.528474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da9a25-9920-400b-9c36-5b2e6c913aa4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.564620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9e72-48b6-487d-b16b-b41c13ec79e1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.566550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.567284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.567678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.568047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.569118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:29.569599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.571196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.590235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 381/775] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:29.591320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.611861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.612780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.613210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.613626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.614409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:29.615415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.617818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.626465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 395/776] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:29.627553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.711037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d5d83-43a3-4a64-abf3-0da00f0dd22b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.714102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:29.740438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990ed7d-798d-489c-90ff-d532eb1df8ed None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.743580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:29.753112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.753702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.753977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.754267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.754925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:29.755245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.757534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.770649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 382/777] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:29.770649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.784696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0a53-895c-4dad-b22b-fa988f9336b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.785327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0a53-895c-4dad-b22b-fa988f9336b2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.785601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0a53-895c-4dad-b22b-fa988f9336b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.785867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0a53-895c-4dad-b22b-fa988f9336b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.800117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee0a53-895c-4dad-b22b-fa988f9336b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.801604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee0a53-895c-4dad-b22b-fa988f9336b2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-70ee0a53-895c-4dad-b22b-fa988f9336b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:29.815536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:29.816494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:29.817390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:29.817390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:29.817390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:29.817390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 396/778] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:29.818469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f6be-6190-4f5e-abab-924387121a52 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.818469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f6be-6190-4f5e-abab-924387121a52 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.818469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f6be-6190-4f5e-abab-924387121a52 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.824679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 397/779] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:29.824679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f6be-6190-4f5e-abab-924387121a52 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.882845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167940-4c3a-46c2-bdd0-d53a6ba91398 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.917835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.918387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.918665 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.918997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.919688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] RBAC: Adding query filter params (interface=public, service_id=7e985e0945a1423bb1f4d8cab940a0ff, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:29.919991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.921345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:29.926532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 383/780] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/endpoints?service_id=7e985e0945a1423bb1f4d8cab940a0ff&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:29.927339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:29.934209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f6be-6190-4f5e-abab-924387121a52 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:29.963186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:29.972011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8af95-88ed-4432-a2eb-3e37bf5d1158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:29.973012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8af95-88ed-4432-a2eb-3e37bf5d1158 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:29.973304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8af95-88ed-4432-a2eb-3e37bf5d1158 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:29.973571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8af95-88ed-4432-a2eb-3e37bf5d1158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:29.984557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8af95-88ed-4432-a2eb-3e37bf5d1158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:29.986055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8af95-88ed-4432-a2eb-3e37bf5d1158 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b7f8af95-88ed-4432-a2eb-3e37bf5d1158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:30.001507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:30.002505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:30.003429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:30.003429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:30.003429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:30.003429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 398/781] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:30.004093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767550c-c380-4b21-be33-ed15b8974f89 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.004093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767550c-c380-4b21-be33-ed15b8974f89 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.004347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767550c-c380-4b21-be33-ed15b8974f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.023512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f767550c-c380-4b21-be33-ed15b8974f89 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:30.024697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f767550c-c380-4b21-be33-ed15b8974f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:30.026787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:30.042632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a852ca-b4b0-4412-a10d-fe611a623b1c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.080901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.081508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.081782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.082050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.082835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:30.083138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:30.084975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.103275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 399/782] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:30.103275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767550c-c380-4b21-be33-ed15b8974f89 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.103566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 384/783] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:30.103566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.214442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:30.228680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f62e4-1f05-49ae-b37a-781f03aa9a25 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.230405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767550c-c380-4b21-be33-ed15b8974f89 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.265694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0553a78-623b-4dc9-a639-f5e7d3dfa18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.266428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0553a78-623b-4dc9-a639-f5e7d3dfa18a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.266835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0553a78-623b-4dc9-a639-f5e7d3dfa18a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.267203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0553a78-623b-4dc9-a639-f5e7d3dfa18a None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.267902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0553a78-623b-4dc9-a639-f5e7d3dfa18a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:30.269713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0553a78-623b-4dc9-a639-f5e7d3dfa18a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.271933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.273052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.273327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.273597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.274500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:30.274828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:30.276222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.276901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 400/784] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:30.277779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0553a78-623b-4dc9-a639-f5e7d3dfa18a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.280968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:30.295078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 385/785] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:30.304734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.424367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0553a78-623b-4dc9-a639-f5e7d3dfa18a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.468767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.469277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.469557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.469827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.477808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:30.479312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.487168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f02f8-d166-45d4-897d-9bfd88adaed9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:30.492024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:30.492903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 401/786] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:30.494194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.527614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.528605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.529082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.529581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.538638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:30.540381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:30.552005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:30.552965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:30.553997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:30.556539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 386/787] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:30.557544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.571844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:30.574211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:30.631145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530fead-2d37-402e-a53e-3b4d37c53147 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.672634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8030c7-f4f3-4c09-ab55-09e16c4d9426 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.686903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5fcba-c423-4a29-99ed-d453c337fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.688102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5fcba-c423-4a29-99ed-d453c337fc4d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.688446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5fcba-c423-4a29-99ed-d453c337fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.688803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5fcba-c423-4a29-99ed-d453c337fc4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.704360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5fcba-c423-4a29-99ed-d453c337fc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-f2c5fcba-c423-4a29-99ed-d453c337fc4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:30.710562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:30.711542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:30.712380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:30.713121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.713706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.713706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.713878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.714469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:30.714794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:30.720588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.720862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 402/788] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:30.721934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5fcba-c423-4a29-99ed-d453c337fc4d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.730631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 387/789] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:30.731553 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.814701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:30.837650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5fcba-c423-4a29-99ed-d453c337fc4d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.856748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e6605-d941-4196-b50e-76e611889412 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:30.860885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:30.883491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.884092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.884363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.884624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.885347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:30.885645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:30.887111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.905267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:30.905913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:30.906192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:30.906454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:30.907137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:30.907433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:30.908761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:30.910125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 403/790] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:30.911002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:30.919981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 388/791] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:30.921398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.026677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e842b-b7dc-4ab5-aa58-2676654a610d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.064891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdacf9-fd3f-45db-b2f4-62c237b37e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.065635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdacf9-fd3f-45db-b2f4-62c237b37e53 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.065934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdacf9-fd3f-45db-b2f4-62c237b37e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.066266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdacf9-fd3f-45db-b2f4-62c237b37e53 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/3b877cb99245408b8ca37c9e85eb023e/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.068355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdacf9-fd3f-45db-b2f4-62c237b37e53 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=3b877cb99245408b8ca37c9e85eb023e, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.069198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b72d4-4bfd-474c-9ba1-cdcfccd35802 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.070313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdacf9-fd3f-45db-b2f4-62c237b37e53 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.083079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 404/792] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:30 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/3b877cb99245408b8ca37c9e85eb023e/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:31.087000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdacf9-fd3f-45db-b2f4-62c237b37e53 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.114327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:31.121765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b7034-2ec9-4f82-8e0b-a097c9f27fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.123220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7034-2ec9-4f82-8e0b-a097c9f27fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.123942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7034-2ec9-4f82-8e0b-a097c9f27fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.124890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7034-2ec9-4f82-8e0b-a097c9f27fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.138618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:31.140286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b7034-2ec9-4f82-8e0b-a097c9f27fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.142898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b7034-2ec9-4f82-8e0b-a097c9f27fb1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1b4b7034-2ec9-4f82-8e0b-a097c9f27fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:31.163981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:31.165200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:31.166291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:31.166291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:31.166291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:31.166888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 389/793] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:31.168879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2601b96-8d67-4348-b483-577dea55504d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.169169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2601b96-8d67-4348-b483-577dea55504d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.169440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2601b96-8d67-4348-b483-577dea55504d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.175146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 390/794] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:31.177458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2601b96-8d67-4348-b483-577dea55504d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.217074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdacf9-fd3f-45db-b2f4-62c237b37e53 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.255544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95df9c9-9612-4b53-9b59-7848d57c4f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.256240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95df9c9-9612-4b53-9b59-7848d57c4f9c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.257257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95df9c9-9612-4b53-9b59-7848d57c4f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.257532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95df9c9-9612-4b53-9b59-7848d57c4f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.269507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95df9c9-9612-4b53-9b59-7848d57c4f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.271016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95df9c9-9612-4b53-9b59-7848d57c4f9c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e95df9c9-9612-4b53-9b59-7848d57c4f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:31.290380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:31.291514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:31.292558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:31.292558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:31.292558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:31.293955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 405/795] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:31.295397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d814fb-df8c-444e-be45-57a7f556aef2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.295833 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d814fb-df8c-444e-be45-57a7f556aef2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.296273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d814fb-df8c-444e-be45-57a7f556aef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.315943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-66d814fb-df8c-444e-be45-57a7f556aef2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:31.317154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-66d814fb-df8c-444e-be45-57a7f556aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:31.326817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2601b96-8d67-4348-b483-577dea55504d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.365843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.366899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.367171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.367435 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.368068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:31.368366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.369703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.387620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 391/796] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:31.388455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.405161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 406/797] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:31.406424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d814fb-df8c-444e-be45-57a7f556aef2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.430193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:31.479396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:31.506885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d814fb-df8c-444e-be45-57a7f556aef2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.547583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.548563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.549039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.549522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.559110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.561583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:31.581850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:31.583287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:31.584194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:31.584194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:31.584194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:31.584194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:31.584194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:31.584194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:31.584194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:31.584194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:31.593646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 407/798] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:31.595734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f5d8-b71e-4ed2-ab7d-a16e34c5b3a8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.598596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.686696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.687237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.687517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.687783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.688430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:31.688733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.690095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.703276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 392/799] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:31.708310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:31.709684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.727997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54c551-bac4-449f-8a7c-ce916714d82c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.771885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.773496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.774043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.774512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.775568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:31.776072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.777800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.793157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 408/800] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:31.795041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.839188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93e29-f4b2-4d1f-80cf-24eb3aaa4ada None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.842317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:31.874978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.875951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.876428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.876944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.885120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.886819 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:31.899228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:31.900184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:31.901155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:31.903769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 393/801] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:31.904807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.905825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1522-6083-4fdd-9a4f-a52913c28a6a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:31.950147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:31.950951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:31.951176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:31.951448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] PATH_INFO: `/v3/services/network` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:31.952038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:31.953402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:31.963745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:31.964776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 04:48:31.965621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:31.969767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 409/802] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:31 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:31.970616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:31.980370 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:32.016146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8332b6-0d95-49f1-9802-8c4222f0d0fd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:32.056259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f010-2869-4a0e-bf4a-07122a52be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:32.057627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f010-2869-4a0e-bf4a-07122a52be27 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.058343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f010-2869-4a0e-bf4a-07122a52be27 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.058793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f010-2869-4a0e-bf4a-07122a52be27 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/58adf938f17647108c2d652565bf3e2b/roles/7b269dca2b46421da0128d1e2da8d456` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.079010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783f010-2869-4a0e-bf4a-07122a52be27 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=58adf938f17647108c2d652565bf3e2b, role_id=7b269dca2b46421da0128d1e2da8d456)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:32.081427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783f010-2869-4a0e-bf4a-07122a52be27 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:32.099559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 394/803] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:31 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/58adf938f17647108c2d652565bf3e2b/roles/7b269dca2b46421da0128d1e2da8d456 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:32.101383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f010-2869-4a0e-bf4a-07122a52be27 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:32.110825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107f6a-6285-4216-8a80-73ec3f3b5d73 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:32.140612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:32.188148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:32.189177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.189777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.190261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.191289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:32.191819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:32.193512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:32.213308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 410/804] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Sep 24 04:48:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:32.219337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:32.276620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f010-2869-4a0e-bf4a-07122a52be27 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:32.315371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:32.315977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.316248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.316512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.317133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:32.317429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:32.320263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:32.325152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 395/805] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:32.331962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:32.345898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:32.414879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9c9d9-c33a-451b-acfe-ff98776b5da2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:32.437475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:32.459083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:32.460308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.460594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.460979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.466082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2003a-31b2-48e0-a582-89f09e2ccaeb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:32.471859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:32.473307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:32.489904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:32.491162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:32.492399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:32.492399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:32.492399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:32.492399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 411/806] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:32.500652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:32.522938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:32.523497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.523774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.524046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.524684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] RBAC: Adding query filter params (type=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:32.525048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:32.526463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:32.538537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 396/807] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:32.559838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:32.656000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaffec2-f5e2-4355-ac59-70374fb91c74 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:32.692321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:32.715538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c42387-4504-4c6a-9088-25a9fcedfb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:32.716524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c42387-4504-4c6a-9088-25a9fcedfb38 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.716799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c42387-4504-4c6a-9088-25a9fcedfb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.717102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c42387-4504-4c6a-9088-25a9fcedfb38 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.717750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c42387-4504-4c6a-9088-25a9fcedfb38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:32.718049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c42387-4504-4c6a-9088-25a9fcedfb38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:32.720025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c42387-4504-4c6a-9088-25a9fcedfb38 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:32.736522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 412/808] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:32.738095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13cd0-dd99-4591-84f9-60dbb7edb0be None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.738376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13cd0-dd99-4591-84f9-60dbb7edb0be None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.738942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13cd0-dd99-4591-84f9-60dbb7edb0be None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.742308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09b472-0fa7-4ed3-8e95-89bf8934837f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:32.744761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 413/809] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:32.746393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13cd0-dd99-4591-84f9-60dbb7edb0be None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:32.786085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a44069-8a1b-4617-9300-6fd167dde3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:32.786790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44069-8a1b-4617-9300-6fd167dde3d8 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.787236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44069-8a1b-4617-9300-6fd167dde3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.787691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44069-8a1b-4617-9300-6fd167dde3d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.789016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a44069-8a1b-4617-9300-6fd167dde3d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:32.791438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a44069-8a1b-4617-9300-6fd167dde3d8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:32.813611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:32.823173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 397/810] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:48:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:32.831210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a5f6-bc6b-4cd7-96ab-822bfc86bbc9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.831707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a5f6-bc6b-4cd7-96ab-822bfc86bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.832108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a5f6-bc6b-4cd7-96ab-822bfc86bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:32.877392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dd87a5f6-bc6b-4cd7-96ab-822bfc86bbc9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:32.878614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dd87a5f6-bc6b-4cd7-96ab-822bfc86bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:32.908020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13cd0-dd99-4591-84f9-60dbb7edb0be None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:32.982714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:32.983304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:32.983577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:32.984152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:33.001703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:33.003261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:33.027228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:33.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:33.031635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 414/811] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:33.035815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 398/812] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:33.036070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:33.068613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:33.142875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387b5e0-a73d-4675-8fb7-ed6c8c5e1289 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:33.177710 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:33.178912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:33.179367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:33.179864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:33.180564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:33.180871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:33.182344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:33.195693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 415/813] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:33.201176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87a5f6-bc6b-4cd7-96ab-822bfc86bbc9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:33.320680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87a5f6-bc6b-4cd7-96ab-822bfc86bbc9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:33.352169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:33.362151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875a38-2e20-4f14-a010-dfde3fd26368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:33.363089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875a38-2e20-4f14-a010-dfde3fd26368 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:33.363541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875a38-2e20-4f14-a010-dfde3fd26368 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:33.363982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875a38-2e20-4f14-a010-dfde3fd26368 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/473bfd2bae82474e81232a3bb364e5bc/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:33.368689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af875a38-2e20-4f14-a010-dfde3fd26368 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=473bfd2bae82474e81232a3bb364e5bc, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:33.370451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af875a38-2e20-4f14-a010-dfde3fd26368 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:33.371190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:33.388438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 399/814] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:33 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/473bfd2bae82474e81232a3bb364e5bc/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:33.481887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:33.492704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201553eb-1d0f-4497-a5b2-c04739e6fff9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:33.531838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88061-345a-4111-9194-19fb2d697074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:33.532472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88061-345a-4111-9194-19fb2d697074 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:33.532746 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88061-345a-4111-9194-19fb2d697074 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:33.533012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88061-345a-4111-9194-19fb2d697074 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:33.533638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88061-345a-4111-9194-19fb2d697074 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:33.535026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88061-345a-4111-9194-19fb2d697074 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-37e88061-345a-4111-9194-19fb2d697074 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:33.546144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:33.547257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:33.548087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 416/815] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Sep 24 04:48:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:33.553620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875a38-2e20-4f14-a010-dfde3fd26368 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:33.557601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a92cbe-13f2-485f-8bef-58a1022a8979 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:33.559173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a92cbe-13f2-485f-8bef-58a1022a8979 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:33.559600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a92cbe-13f2-485f-8bef-58a1022a8979 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:33.561468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 417/816] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:33.567192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb682eb-2179-4472-a30b-b712c03ac61a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:33.567192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb682eb-2179-4472-a30b-b712c03ac61a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:33.567437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb682eb-2179-4472-a30b-b712c03ac61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:33.588262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8bb682eb-2179-4472-a30b-b712c03ac61a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:33.589409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8bb682eb-2179-4472-a30b-b712c03ac61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:33.687621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 418/817] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:33.780445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875a38-2e20-4f14-a010-dfde3fd26368 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:33.821218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:33.821811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:33.822081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:33.822342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:33.822986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:33.823279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:33.824664 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:33.829438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 400/818] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 24 04:48:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:33.835307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb682eb-2179-4472-a30b-b712c03ac61a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:33.925379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:33.941511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb682eb-2179-4472-a30b-b712c03ac61a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:33.968376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:33.979229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:33.980391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:33.980865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:33.981302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:33.982392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:33.983114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:33.984776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:33.991843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 419/819] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 24 04:48:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:33.997412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:34.028943 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:34.091879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24c1f1-c1db-4f5d-b059-b49a8484c60a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:34.119276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516da0-a5e2-4b73-a8a4-3e5d7a36a958 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:34.129589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939e95-475f-4665-81a9-2bb2ff5be16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:34.130309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939e95-475f-4665-81a9-2bb2ff5be16a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:34.130651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939e95-475f-4665-81a9-2bb2ff5be16a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:34.131034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939e95-475f-4665-81a9-2bb2ff5be16a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:34.142966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3939e95-475f-4665-81a9-2bb2ff5be16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c3939e95-475f-4665-81a9-2bb2ff5be16a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:34.149058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:34.150050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:34.151180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:34.154820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 401/820] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:34.157041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939e95-475f-4665-81a9-2bb2ff5be16a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:34.169839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7be02-f982-4353-892f-b4724482f77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:34.170761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7be02-f982-4353-892f-b4724482f77f None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:34.171629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7be02-f982-4353-892f-b4724482f77f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:34.172375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7be02-f982-4353-892f-b4724482f77f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:34.173291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7be02-f982-4353-892f-b4724482f77f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:34.175514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7be02-f982-4353-892f-b4724482f77f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:34.211386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 420/821] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:48:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:48:34.278028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939e95-475f-4665-81a9-2bb2ff5be16a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:34.292956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:34.329266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:34.329881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:34.330160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:34.330432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:34.331134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:34.331496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:34.332884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:34.347649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 402/822] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:34.353446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7be02-f982-4353-892f-b4724482f77f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:34.364325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:34.472647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7be02-f982-4353-892f-b4724482f77f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:34.509999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0080d-a3a4-4157-94b8-3ba5505e8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:34.510983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0080d-a3a4-4157-94b8-3ba5505e8240 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:34.511481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0080d-a3a4-4157-94b8-3ba5505e8240 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:34.511942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0080d-a3a4-4157-94b8-3ba5505e8240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:34.523770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0080d-a3a4-4157-94b8-3ba5505e8240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:34.525609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0080d-a3a4-4157-94b8-3ba5505e8240 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-6da0080d-a3a4-4157-94b8-3ba5505e8240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:34.541737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:34.542783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:34.543679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:34.543679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:34.543679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:34.545748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 421/823] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:34.551141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:34.666579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdd7ed-8162-46f0-9b28-ae67ffbbec71 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:34.702899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:34.703547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:34.703824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:34.704089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:34.704717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:34.705013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:34.706506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:34.720028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 403/824] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:34.721936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea53e-74bf-4616-adf9-55e1d328be23 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:34.722407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea53e-74bf-4616-adf9-55e1d328be23 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:34.722496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea53e-74bf-4616-adf9-55e1d328be23 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:34.724876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 422/825] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:34.726691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:34.729706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6388-155a-4c10-9b06-63551c992b8e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:34.729993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6388-155a-4c10-9b06-63551c992b8e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:34.730270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6388-155a-4c10-9b06-63551c992b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:34.748897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6bac6388-155a-4c10-9b06-63551c992b8e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:34.750097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6bac6388-155a-4c10-9b06-63551c992b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:34.763809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:34.822614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:34.840906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 423/826] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:34.859843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ac259-933a-42de-9428-ce529d7915f5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:34.899123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:34.900172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:34.900653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:34.901122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:34.908742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:34.910474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:34.922707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:34.923645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:48:34.924599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:34.930885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 404/827] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:48:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:34.933728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac6388-155a-4c10-9b06-63551c992b8e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.041606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac6388-155a-4c10-9b06-63551c992b8e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.077464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.078069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.078347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.078619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.079379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:35.079686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:35.081124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:35.100671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 424/828] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:48:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:35.106597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.140129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.189107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:35.207977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:35.220076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f706-a925-4f5c-a362-f05c9d792390 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.250634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec105b-7cbf-404d-a006-354c974f2635 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.259990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b4623-7bb1-4d9a-ab69-d85e449c85dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.260929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b4623-7bb1-4d9a-ab69-d85e449c85dc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.261410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b4623-7bb1-4d9a-ab69-d85e449c85dc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.261983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b4623-7bb1-4d9a-ab69-d85e449c85dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.289692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508be50-f5d0-4eb7-9c9a-ff5332e9f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.290118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508be50-f5d0-4eb7-9c9a-ff5332e9f69b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.290402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508be50-f5d0-4eb7-9c9a-ff5332e9f69b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.290672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508be50-f5d0-4eb7-9c9a-ff5332e9f69b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.302076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508be50-f5d0-4eb7-9c9a-ff5332e9f69b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-6508be50-f5d0-4eb7-9c9a-ff5332e9f69b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:35.307172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:35.308125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:48:35.308959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:35.313446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 425/829] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:35.314125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508be50-f5d0-4eb7-9c9a-ff5332e9f69b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.340927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b4623-7bb1-4d9a-ab69-d85e449c85dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:35.342832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b4623-7bb1-4d9a-ab69-d85e449c85dc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:35.423345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508be50-f5d0-4eb7-9c9a-ff5332e9f69b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.431923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:35.440316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:35.454857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 405/830] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:48:35.457359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b4623-7bb1-4d9a-ab69-d85e449c85dc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.464069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.464676 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.464952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.465222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.465892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:35.466194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:35.467746 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:35.481596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 426/831] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:35.482497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.563861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b4623-7bb1-4d9a-ab69-d85e449c85dc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.595568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ae229-9820-4990-81a9-d9f69f936a49 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.603880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.604899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.605378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.605842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.631022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:35.632721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.633291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:35.633403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.633621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.633897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.645914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:35.648058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:35.653875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:35.654851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:35.655749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:35.655749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:35.655749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:35.656941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 406/832] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:35.663114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:35.670424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:35.671410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:35.672289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:35.672289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:35.672289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:35.676379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 427/833] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:35.677210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.701823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:35.718327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:35.780609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d14a5-6b32-4437-a51d-1ee6af669df0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.789264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5ba0c-7b12-4ce4-9762-6bec057d001a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.816421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56f4e8-147e-4bc5-a02c-322810ae8b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.817258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56f4e8-147e-4bc5-a02c-322810ae8b03 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.817720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56f4e8-147e-4bc5-a02c-322810ae8b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.818174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56f4e8-147e-4bc5-a02c-322810ae8b03 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.819542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56f4e8-147e-4bc5-a02c-322810ae8b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:35.820048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56f4e8-147e-4bc5-a02c-322810ae8b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:35.821654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56f4e8-147e-4bc5-a02c-322810ae8b03 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:35.824812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.825410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.825683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.825955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.826588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:35.826917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:35.828269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:35.838937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 407/834] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:35.840697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d89e1-852b-4bf7-8dfa-b12906504c15 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.841147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d89e1-852b-4bf7-8dfa-b12906504c15 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.845604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 428/835] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:35.845711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d89e1-852b-4bf7-8dfa-b12906504c15 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.845789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.845884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 408/836] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:35.846428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d89e1-852b-4bf7-8dfa-b12906504c15 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:35.931948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:35.952016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95cd17-4318-4e8b-8b9a-0e93561efe77 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.960553 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d89e1-852b-4bf7-8dfa-b12906504c15 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:35.962194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:35.986915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5509d-9431-4559-8cc9-a2356fb7c989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:35.987585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5509d-9431-4559-8cc9-a2356fb7c989 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:35.987863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5509d-9431-4559-8cc9-a2356fb7c989 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:35.988135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5509d-9431-4559-8cc9-a2356fb7c989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:35.995060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5509d-9431-4559-8cc9-a2356fb7c989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:35.996516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5509d-9431-4559-8cc9-a2356fb7c989 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:35.999371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:36.000168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.000590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.001005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e9c5509d-9431-4559-8cc9-a2356fb7c989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:36.008454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:36.009552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 429/837] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8cb2-0603-44f6-809e-5e4f5e5f7bef None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.011781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8cb2-0603-44f6-809e-5e4f5e5f7bef None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.012399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8cb2-0603-44f6-809e-5e4f5e5f7bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.014832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:36.016499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:36.029220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-20bb8cb2-0603-44f6-809e-5e4f5e5f7bef None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:36.030003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:36.030959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:36.031912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:36.032435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-20bb8cb2-0603-44f6-809e-5e4f5e5f7bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:36.032515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 409/838] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:48:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:36.032515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.104302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 430/839] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:36.105425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8cb2-0603-44f6-809e-5e4f5e5f7bef None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.172161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f913e-a04c-4cfa-8960-fd8347b5cc22 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:36.185307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:36.219425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8cb2-0603-44f6-809e-5e4f5e5f7bef None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:36.226495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:36.227872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.228399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.228867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.230242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:36.230762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:36.233038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:36.251774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 410/840] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:36.255799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:36.256569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.257130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.257575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.257742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.258424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:36.258857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:36.260321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:36.279656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 431/841] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:36.285282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.290613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:36.391475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c019001-41f0-4ed0-bd8c-6bb86587a684 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:36.398108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632beee-e5d3-4b75-8263-d058e1e1d670 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:36.425551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:36.430435 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:36.431125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.431366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.431623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.432366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=3b877cb99245408b8ca37c9e85eb023e) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:36.432677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:36.434448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:36.435962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1686-ae59-4fa4-af51-787a8f07d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:36.436587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1686-ae59-4fa4-af51-787a8f07d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.436858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1686-ae59-4fa4-af51-787a8f07d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.437120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1686-ae59-4fa4-af51-787a8f07d7a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.443032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 411/842] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/role_assignments?user.id=3b877cb99245408b8ca37c9e85eb023e&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:36.444311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.533073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1686-ae59-4fa4-af51-787a8f07d7a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:36.535635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1686-ae59-4fa4-af51-787a8f07d7a7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:36.567265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:36.585940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd8388-cd1d-4650-baca-823dd52321fe None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:36.624734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a91875-9834-474c-9f3e-b0de501a8c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:36.625800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a91875-9834-474c-9f3e-b0de501a8c8d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.626080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a91875-9834-474c-9f3e-b0de501a8c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.626356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a91875-9834-474c-9f3e-b0de501a8c8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.641380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a91875-9834-474c-9f3e-b0de501a8c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e1a91875-9834-474c-9f3e-b0de501a8c8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:36.647584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:36.648528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:36.649879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 412/843] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:36.650739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0092c1-74d8-4911-acd1-9f40799ea5ce None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.650739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0092c1-74d8-4911-acd1-9f40799ea5ce None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.650739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0092c1-74d8-4911-acd1-9f40799ea5ce None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.652181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 413/844] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:36.654339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0092c1-74d8-4911-acd1-9f40799ea5ce None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.663828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 432/845] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 04:48:36.665303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa56e-aec0-49a9-9a21-a6b89dbf56e0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.665583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa56e-aec0-49a9-9a21-a6b89dbf56e0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.665901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa56e-aec0-49a9-9a21-a6b89dbf56e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.689498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d2cfa56e-aec0-49a9-9a21-a6b89dbf56e0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:36.690717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d2cfa56e-aec0-49a9-9a21-a6b89dbf56e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:36.716662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:36.765177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 433/846] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:36.767632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa56e-aec0-49a9-9a21-a6b89dbf56e0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.784472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0092c1-74d8-4911-acd1-9f40799ea5ce None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:36.831152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:36.832231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.832736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.833208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.834923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:36.835855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:36.837811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:36.848913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 414/847] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:36.855062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.868536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:36.887007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa56e-aec0-49a9-9a21-a6b89dbf56e0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:36.931960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:36.932917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:36.933206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:36.933482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:36.950661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:36.952147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:36.969030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:36.970020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:36.970944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:36.970944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:36.970944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:36.974785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 434/848] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:36.976301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:36.978664 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560c36-575f-419d-b68a-796e6417b273 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:36.991110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:37.020962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.022501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.023069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.023342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.034309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.035782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:37.054320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:37.055399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:37.056318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:37.056318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:37.056318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:37.056502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 415/849] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:37.057304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.103377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d59404-1fe8-410f-9435-cd127e4c1565 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.123659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:37.139770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.140375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.140650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.141214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.141666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:37.141966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.143471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.157552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 435/850] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:37.159807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.165985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d098-f295-4b68-8d61-ebd9386923a0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.202555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.203134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.203411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.203678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.204630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.206292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:37.216717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:37.217880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:37.218720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 416/851] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:37.220298 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.239201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:37.273587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e86f33-ae5f-4509-8f57-885db3471a79 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.308584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.309429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.309709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.309979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.310620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:37.310971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.312333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.328497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 436/852] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:37.328497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.331316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e866-07a4-42f9-942a-4256c7ae8b1a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.356436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:37.368209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.368830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.369101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.369366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.376406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.377811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:37.393354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:37.394351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 417/853] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:37.396030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.443095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ed91-20c5-4230-98e7-002f2749fb28 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.476770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:37.483622 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.484225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.484501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.484769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.485555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:37.485876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.487348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.497442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 437/854] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:37.497442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.506773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c078e5-214a-45b7-a51a-fb8a13a43329 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.543473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.544094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.544366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.544634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.551951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.553524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:37.565787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:37.566730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 04:48:37.567714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:37.568247 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 418/855] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:37.569799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.605870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d2144-7610-40a5-8da4-5c01badba6e1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.620806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:37.643683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.644286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.644563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.644833 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.645632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:37.646052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.650577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.666253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 438/856] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:37.667411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.685039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90656-19d7-4ddc-9eb2-51bf7a848711 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.721426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.722028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.722307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.722578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.723661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:37.723973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.725839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.726235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:37.731012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 419/857] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:37.731755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.803672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c4c2a-543f-4417-956e-ab3aa2669175 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.859166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.859796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.860208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.860609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.861378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:37.861689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.863938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.870718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b39042-920a-4553-805e-7d81ef1a2198 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:37.882053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:37.890626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 439/858] 10.222.0.26 () {56 vars in 1135 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:37.898123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:37.921325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:37.922834 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:37.923509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:37.923778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:37.924822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=58adf938f17647108c2d652565bf3e2b) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:37.925128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:37.926530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:37.935816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 420/859] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/role_assignments?user.id=58adf938f17647108c2d652565bf3e2b&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:38.025513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9df81-7f57-454f-9fe7-c9ba18061031 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:38.041373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:38.066789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc7768-a928-4b67-8ecf-62463dea00b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:38.067434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc7768-a928-4b67-8ecf-62463dea00b7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:38.067711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc7768-a928-4b67-8ecf-62463dea00b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:38.067981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc7768-a928-4b67-8ecf-62463dea00b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:38.145486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc7768-a928-4b67-8ecf-62463dea00b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:38.147087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc7768-a928-4b67-8ecf-62463dea00b7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:38.255736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 440/860] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 04:48:38.261068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:38.374625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5289e17-621e-432a-bf83-ea79fb04cdac None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:38.410176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:38.410825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:38.411106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:38.411377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:38.423157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:38.424604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:38.439050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:38.439982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:38.440889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:38.440889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:38.440889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:38.440889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 421/861] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:38.446184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc7768-a928-4b67-8ecf-62463dea00b7 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:38.465294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:38.550373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc7768-a928-4b67-8ecf-62463dea00b7 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:38.586795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82cc92-49a2-4ac8-827b-3671a192a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:38.587409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82cc92-49a2-4ac8-827b-3671a192a935 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:38.587686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82cc92-49a2-4ac8-827b-3671a192a935 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:38.587958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82cc92-49a2-4ac8-827b-3671a192a935 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:38.588604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82cc92-49a2-4ac8-827b-3671a192a935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:38.588904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82cc92-49a2-4ac8-827b-3671a192a935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:38.590272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82cc92-49a2-4ac8-827b-3671a192a935 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:38.602538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 441/862] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:38.608098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:38.639424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:38.723701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b034e56-e4d3-40b8-97e4-224989f01ec5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:38.747747 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea6221-c71e-487a-9d47-5e1053096e04 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:38.748096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea6221-c71e-487a-9d47-5e1053096e04 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:38.748734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea6221-c71e-487a-9d47-5e1053096e04 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:38.751134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 442/863] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:48:38.758236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b05b-a043-4508-98a2-4c0b5b68258f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:38.758526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b05b-a043-4508-98a2-4c0b5b68258f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:38.758841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b05b-a043-4508-98a2-4c0b5b68258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:38.768161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:38.768795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:38.769068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:38.769332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:38.778400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:38.779886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:38.781839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ee44b05b-a043-4508-98a2-4c0b5b68258f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:38.783439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ee44b05b-a043-4508-98a2-4c0b5b68258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:38.795094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:38.796046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:38.796951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 422/864] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:38.801814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:38.883111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 443/865] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:38.897661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:38.915525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f3c81-bd02-4496-b6b5-b2627addfee1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:38.953515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:38.954173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:38.954454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:38.954728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:38.955550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:38.955757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:38.957167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:38.970453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 423/866] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:38.976984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b05b-a043-4508-98a2-4c0b5b68258f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:38.979557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:39.081788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b05b-a043-4508-98a2-4c0b5b68258f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:39.118078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:39.118666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:39.118964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:39.119230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:39.119944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=473bfd2bae82474e81232a3bb364e5bc) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:39.120245 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:39.121672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:39.128286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 444/867] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:38 2022] GET /identity/v3/role_assignments?user.id=473bfd2bae82474e81232a3bb364e5bc&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:39.155358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:39.278369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bd362-0b2b-402d-8910-f0abecc638e3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:39.317560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:39.318193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:39.318469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:39.318851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:39.319443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:39.320925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:39.330067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:39.331132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:39.332105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 424/868] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Sep 24 04:48:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:39.338025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:39.406473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:39.447661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed625bab-05ea-494f-9d98-b15173ccaa86 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:39.483226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb481110-3718-468e-beb1-bd713a1c178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:39.484193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb481110-3718-468e-beb1-bd713a1c178f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:39.484677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb481110-3718-468e-beb1-bd713a1c178f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:39.485160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb481110-3718-468e-beb1-bd713a1c178f None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:39.485977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb481110-3718-468e-beb1-bd713a1c178f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:39.486478 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb481110-3718-468e-beb1-bd713a1c178f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:39.488053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb481110-3718-468e-beb1-bd713a1c178f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:39.493493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 445/869] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:39.500134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:39.512357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:39.609835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa39f1-6c04-4bf2-b9fb-0615d3a5f9e3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:39.646618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88133370-17c8-46d4-9612-fb61c86573f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:39.647767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133370-17c8-46d4-9612-fb61c86573f7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:39.648276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133370-17c8-46d4-9612-fb61c86573f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:39.648762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133370-17c8-46d4-9612-fb61c86573f7 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:39.649606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88133370-17c8-46d4-9612-fb61c86573f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:39.650124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88133370-17c8-46d4-9612-fb61c86573f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:39.651797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88133370-17c8-46d4-9612-fb61c86573f7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:39.657595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 425/870] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:40.151414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b402c4-47a8-4c55-a94b-b6232e0ab409 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:40.152072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b402c4-47a8-4c55-a94b-b6232e0ab409 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:40.152072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b402c4-47a8-4c55-a94b-b6232e0ab409 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:40.153928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 446/871] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:40.160191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b517e-87c4-4f0f-828b-267dfcd2d447 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:40.160529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b517e-87c4-4f0f-828b-267dfcd2d447 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:40.160735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b517e-87c4-4f0f-828b-267dfcd2d447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:40.182881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-026b517e-87c4-4f0f-828b-267dfcd2d447 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:40.184082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-026b517e-87c4-4f0f-828b-267dfcd2d447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:40.257648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8aa08-a3f7-4392-b1dd-5bb99751f30c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:40.257991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8aa08-a3f7-4392-b1dd-5bb99751f30c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:40.258190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8aa08-a3f7-4392-b1dd-5bb99751f30c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:40.261080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 447/872] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:40.265251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371c7a-e739-454a-9f8c-8505d32e11a3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:40.265586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371c7a-e739-454a-9f8c-8505d32e11a3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:40.265803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371c7a-e739-454a-9f8c-8505d32e11a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:40.285138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c0371c7a-e739-454a-9f8c-8505d32e11a3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:40.285461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 426/873] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:40.286421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c0371c7a-e739-454a-9f8c-8505d32e11a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:40.359638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 448/874] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:40.568145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b517e-87c4-4f0f-828b-267dfcd2d447 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:40.571365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:40.632725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371c7a-e739-454a-9f8c-8505d32e11a3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:40.680273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b517e-87c4-4f0f-828b-267dfcd2d447 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:40.719844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aba77-b23f-45b0-afcb-bda2e99fca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:40.720623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aba77-b23f-45b0-afcb-bda2e99fca75 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:40.720968 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aba77-b23f-45b0-afcb-bda2e99fca75 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:40.721329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aba77-b23f-45b0-afcb-bda2e99fca75 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:40.722058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7aba77-b23f-45b0-afcb-bda2e99fca75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:40.723577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7aba77-b23f-45b0-afcb-bda2e99fca75 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:40.724558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:40.746841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 427/875] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:48:40 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:40.784192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371c7a-e739-454a-9f8c-8505d32e11a3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:40.838828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06643c-ba55-456e-9547-75945d80c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:40.838828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06643c-ba55-456e-9547-75945d80c895 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:40.838828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06643c-ba55-456e-9547-75945d80c895 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:40.838828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06643c-ba55-456e-9547-75945d80c895 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:40.854350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06643c-ba55-456e-9547-75945d80c895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-8e06643c-ba55-456e-9547-75945d80c895 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:40.860090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:40.861304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:48:40.863330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:40.867497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 449/876] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Sep 24 04:48:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:40.877250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aba77-b23f-45b0-afcb-bda2e99fca75 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:40.952174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:41.002016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aba77-b23f-45b0-afcb-bda2e99fca75 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:41.038948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:41.039555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:41.039832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:41.040101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:41.040767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:41.041065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:41.042422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:41.051426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 428/877] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Sep 24 04:48:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:41.057402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06643c-ba55-456e-9547-75945d80c895 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:41.169856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06643c-ba55-456e-9547-75945d80c895 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:41.188538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:41.208226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:41.209169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:41.210239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:41.210697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:41.221030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:41.222679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:41.237788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:41.238814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:41.239751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:41.239751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:41.239751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:41.241646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 450/878] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:41.247217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:41.354713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3144f2-8b1e-4a41-bbf0-fab28b32dc6d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:41.380013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:41.391611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30afa6-bb50-4b7e-8fa9-d6b23e04514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:41.392466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30afa6-bb50-4b7e-8fa9-d6b23e04514b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:41.392939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30afa6-bb50-4b7e-8fa9-d6b23e04514b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:41.393380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30afa6-bb50-4b7e-8fa9-d6b23e04514b None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:41.394181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30afa6-bb50-4b7e-8fa9-d6b23e04514b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:41.394661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30afa6-bb50-4b7e-8fa9-d6b23e04514b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:41.396191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30afa6-bb50-4b7e-8fa9-d6b23e04514b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:41.409851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 429/879] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:41.419997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:41.527294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e856-d3d6-41c7-9d76-ef5c690e4368 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:41.535466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc88a3-471f-43a0-9e77-b0208f018fb1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:41.536027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc88a3-471f-43a0-9e77-b0208f018fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:41.536514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc88a3-471f-43a0-9e77-b0208f018fb1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:41.538373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 430/880] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:41.543868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7851c-a733-4c3e-86f0-d3c0a969ed8e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:41.544398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7851c-a733-4c3e-86f0-d3c0a969ed8e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:41.544937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7851c-a733-4c3e-86f0-d3c0a969ed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:41.565227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f9d7851c-a733-4c3e-86f0-d3c0a969ed8e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:41.566129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:41.566409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f9d7851c-a733-4c3e-86f0-d3c0a969ed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:41.567206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:41.567690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:41.568184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:41.577207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:41.579203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:41.592411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:41.593419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:41.594374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:41.597065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 451/881] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:48:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:41.603636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:41.636056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:41.662904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 431/882] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:41.726067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1c251-2a43-4676-a4db-dbac0a277159 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:41.762112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:41.762736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:41.763032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:41.763302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:41.764048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:41.764349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:41.765811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:41.784915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 452/883] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Sep 24 04:48:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:41.791442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7851c-a733-4c3e-86f0-d3c0a969ed8e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:41.893304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7851c-a733-4c3e-86f0-d3c0a969ed8e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:41.907912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:41.929255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada225f2-d8d9-44ae-bd82-0ac6941c9baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:41.929857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada225f2-d8d9-44ae-bd82-0ac6941c9baf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:41.930132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada225f2-d8d9-44ae-bd82-0ac6941c9baf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:41.930401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada225f2-d8d9-44ae-bd82-0ac6941c9baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:41.959842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:42.002266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada225f2-d8d9-44ae-bd82-0ac6941c9baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:42.004322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada225f2-d8d9-44ae-bd82-0ac6941c9baf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:42.057500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:42.074389 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31830f77-f46f-4b92-9b0d-425ab2691b38 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:42.109961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9502616-3b3f-4bd4-b95a-087cf74f24c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:42.110587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502616-3b3f-4bd4-b95a-087cf74f24c4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.110891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502616-3b3f-4bd4-b95a-087cf74f24c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.111163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502616-3b3f-4bd4-b95a-087cf74f24c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.111742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9502616-3b3f-4bd4-b95a-087cf74f24c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:42.113129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9502616-3b3f-4bd4-b95a-087cf74f24c4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c9502616-3b3f-4bd4-b95a-087cf74f24c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:42.123423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:42.124727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:42.125577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 453/884] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:42.127115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a562b4c-0f7f-49d5-8223-b42a5174d0c4 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.127397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a562b4c-0f7f-49d5-8223-b42a5174d0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.127795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a562b4c-0f7f-49d5-8223-b42a5174d0c4 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.129322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 454/885] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:42.134935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a562b4c-0f7f-49d5-8223-b42a5174d0c4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:42.138102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 432/886] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:41 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:48:42.139626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8290-be7b-4fef-9ffd-1b35b8c97d35 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.139758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8290-be7b-4fef-9ffd-1b35b8c97d35 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.140023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8290-be7b-4fef-9ffd-1b35b8c97d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.160365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c7ba8290-be7b-4fef-9ffd-1b35b8c97d35 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:42.161789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7ba8290-be7b-4fef-9ffd-1b35b8c97d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:42.172613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:42.236578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 433/887] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:42.237425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba8290-be7b-4fef-9ffd-1b35b8c97d35 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:42.255668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a562b4c-0f7f-49d5-8223-b42a5174d0c4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:42.305795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:42.306941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.307364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.307777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.308560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:42.309169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:42.311227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:42.317579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 455/888] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:42.323926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:42.341819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:42.357999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba8290-be7b-4fef-9ffd-1b35b8c97d35 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:42.404557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:42.405516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.405982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.406433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.420175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:42.422367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:42.425654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:42.438533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e971-99b1-4b23-8387-f7bc38995191 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:42.444763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:42.445993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:42.446935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:42.446935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:42.446935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:42.452482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 434/889] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:42.454016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:42.483914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:42.484829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.485458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.485658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.486433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:42.486824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:42.488455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:42.499103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 456/890] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:42.510091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:42.584704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd577a-4705-49e0-9304-8cfd9907d277 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:42.620849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:42.625085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:42.626163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.626452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.626726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.627485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:42.627795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:42.629585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:42.649497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 435/891] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:42.655496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:42.667270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dde66b-df27-4f82-b7bc-17fd405c3afc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:42.714565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835c6ff-f4cd-425e-b52d-4f40340c389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:42.715376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c6ff-f4cd-425e-b52d-4f40340c389d None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.715743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c6ff-f4cd-425e-b52d-4f40340c389d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.716124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c6ff-f4cd-425e-b52d-4f40340c389d None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.716847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835c6ff-f4cd-425e-b52d-4f40340c389d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:42.718268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835c6ff-f4cd-425e-b52d-4f40340c389d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:42.729603 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:42.742148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 457/892] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:48:42 2022] POST /identity/v3/services => generated 269 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:48:42.789999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e98ab8-54f3-4099-a598-fe004e06cc15 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:42.840265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:42.841282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:42.841815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:42.842326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:42.850915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:42.852867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:42.866669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:42.867736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:42.868688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:42.868688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:42.868688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:42.868688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:42.868688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:42.868688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:42.868688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:42.868688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:42.871393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 436/893] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:42.882340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835c6ff-f4cd-425e-b52d-4f40340c389d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:42.995077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835c6ff-f4cd-425e-b52d-4f40340c389d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:43.031267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65689ad-86d6-49f0-ba56-594b673c906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:43.031876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65689ad-86d6-49f0-ba56-594b673c906c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:43.032153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65689ad-86d6-49f0-ba56-594b673c906c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:43.032426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65689ad-86d6-49f0-ba56-594b673c906c None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:43.033123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65689ad-86d6-49f0-ba56-594b673c906c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:43.033429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65689ad-86d6-49f0-ba56-594b673c906c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:43.034882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65689ad-86d6-49f0-ba56-594b673c906c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:43.043023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:43.048554 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 458/894] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:43.055725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:43.090815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c637500-9865-4dc4-8b78-6fe0e7dbd435 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:43.090815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c637500-9865-4dc4-8b78-6fe0e7dbd435 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:43.090815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c637500-9865-4dc4-8b78-6fe0e7dbd435 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:43.091449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 459/895] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:48:43.096460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638865ed-2190-4760-b903-dc324e3f2bfd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:43.097108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638865ed-2190-4760-b903-dc324e3f2bfd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:43.097582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638865ed-2190-4760-b903-dc324e3f2bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:43.117725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-638865ed-2190-4760-b903-dc324e3f2bfd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:43.119291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-638865ed-2190-4760-b903-dc324e3f2bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:43.176670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1060c24-c668-4101-87b2-fb910b12152d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:43.191409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:43.200336 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 460/896] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:43.218851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:43.219453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:43.219728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:43.219995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:43.220716 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] RBAC: Adding query filter params (role.id=1b00469c884a4dbeb71c91c3bcc4a347, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=58adf938f17647108c2d652565bf3e2b) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:43.221085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:43.222540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:43.229437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 437/897] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:43 2022] GET /identity/v3/role_assignments?user.id=58adf938f17647108c2d652565bf3e2b&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=1b00469c884a4dbeb71c91c3bcc4a347 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:43.473674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638865ed-2190-4760-b903-dc324e3f2bfd None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:43.577851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638865ed-2190-4760-b903-dc324e3f2bfd None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:43.606367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:43.613931 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:43.614558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:43.615031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:43.615129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:43.616582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:43.618046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:43.629613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:43.630608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:43.631589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 461/898] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:43.636592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:43.758021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73d3ce-4d52-4112-959e-c9b5f6a14850 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:43.796980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:43.797584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:43.797910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:43.798188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:43.798842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:43.799149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:43.800502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:43.806147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 438/899] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:43.811755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:43.919401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad054-7601-4d8b-a73c-a1ff56e880b3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:43.954376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:43.955006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:43.955281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:43.955550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:43.956175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:43.956473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:43.957832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:43.963982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 462/900] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:43.969731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:44.013697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:44.074645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27df475-d485-4ceb-bd95-f372c12ca1f9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:44.113475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca1a08-cfe2-4c2f-bafd-8761c23ada56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:44.114080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1a08-cfe2-4c2f-bafd-8761c23ada56 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:44.114356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1a08-cfe2-4c2f-bafd-8761c23ada56 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:44.114628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1a08-cfe2-4c2f-bafd-8761c23ada56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:44.115351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca1a08-cfe2-4c2f-bafd-8761c23ada56 None admin] RBAC: Adding query filter params (interface=public, service_id=46e7ebd7179943efa9b9b45bf228195d, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:44.116318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca1a08-cfe2-4c2f-bafd-8761c23ada56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:44.117670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca1a08-cfe2-4c2f-bafd-8761c23ada56 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:44.123171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 439/901] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 24 04:48:43 2022] GET /identity/v3/endpoints?service_id=46e7ebd7179943efa9b9b45bf228195d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:44.129019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:44.188682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:44.235084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0bce-ec57-455d-8f9b-828bd1c7535f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:44.271984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae1b88-e6d8-4587-8c9b-e14934cadd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:44.272921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1b88-e6d8-4587-8c9b-e14934cadd06 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:44.273416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1b88-e6d8-4587-8c9b-e14934cadd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:44.273881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1b88-e6d8-4587-8c9b-e14934cadd06 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:44.274672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae1b88-e6d8-4587-8c9b-e14934cadd06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:44.276342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae1b88-e6d8-4587-8c9b-e14934cadd06 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:44.282525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 463/902] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:48:44 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 04:48:44.880704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419ec9-975b-4665-bd03-10d603a02e70 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:44.881774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419ec9-975b-4665-bd03-10d603a02e70 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:44.881774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419ec9-975b-4665-bd03-10d603a02e70 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:44.883659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 440/903] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:44.889071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca85dcd-a7cd-4729-a218-c017ace9a7d4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:44.889520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca85dcd-a7cd-4729-a218-c017ace9a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:44.889600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca85dcd-a7cd-4729-a218-c017ace9a7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:44.909361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-aca85dcd-a7cd-4729-a218-c017ace9a7d4 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:44.910652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-aca85dcd-a7cd-4729-a218-c017ace9a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:44.985078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 464/904] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:45.028008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be274-7869-4f42-9d1b-f4b421f2a9f1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:45.028322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be274-7869-4f42-9d1b-f4b421f2a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:45.028546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be274-7869-4f42-9d1b-f4b421f2a9f1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:45.030120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 441/905] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:45.035240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd12e30-5729-4e00-bc67-cb4bdd30d8ef None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:45.035522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd12e30-5729-4e00-bc67-cb4bdd30d8ef None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:45.035794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd12e30-5729-4e00-bc67-cb4bdd30d8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:45.054664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bdd12e30-5729-4e00-bc67-cb4bdd30d8ef None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:45.056071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bdd12e30-5729-4e00-bc67-cb4bdd30d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:45.102269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:45.124898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 465/906] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:45.280267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be274-7869-4f42-9d1b-f4b421f2a9f1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:45.394385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd12e30-5729-4e00-bc67-cb4bdd30d8ef None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:45.394802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be274-7869-4f42-9d1b-f4b421f2a9f1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:45.399131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:45.436714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869749d-b82e-4192-a334-4999d5f5b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:45.437701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869749d-b82e-4192-a334-4999d5f5b662 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:45.438181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869749d-b82e-4192-a334-4999d5f5b662 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:45.438662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869749d-b82e-4192-a334-4999d5f5b662 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:45.439558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869749d-b82e-4192-a334-4999d5f5b662 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:45.441279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869749d-b82e-4192-a334-4999d5f5b662 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:45.458442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 442/907] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:48:45 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:45.503531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8218d-41b6-485b-8659-7d77e58c6494 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:45.503905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8218d-41b6-485b-8659-7d77e58c6494 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:45.504091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8218d-41b6-485b-8659-7d77e58c6494 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:45.505615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 443/908] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:48:45.512323 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70bfdc-3f09-4f23-a9d4-b282a9fd229b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:45.512978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70bfdc-3f09-4f23-a9d4-b282a9fd229b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:45.513439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70bfdc-3f09-4f23-a9d4-b282a9fd229b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:45.533412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd12e30-5729-4e00-bc67-cb4bdd30d8ef None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:45.535330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1b70bfdc-3f09-4f23-a9d4-b282a9fd229b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:45.536861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1b70bfdc-3f09-4f23-a9d4-b282a9fd229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:45.585817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:45.586529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:45.586883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:45.587254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:45.587853 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:45.589259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:45.603779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:45.604795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:45.605681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 466/909] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Sep 24 04:48:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:45.611255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:45.639011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 444/910] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:45.666452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:45.728142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6cce-6732-4044-b739-dd032f1b295e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:45.763788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:45.764397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:45.764678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:45.764948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:45.765575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:45.765927 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:45.767327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:45.772743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 467/911] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:45.780116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70bfdc-3f09-4f23-a9d4-b282a9fd229b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:45.880980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:45.888245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70bfdc-3f09-4f23-a9d4-b282a9fd229b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:45.907570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:45.930478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:45.931118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:45.931399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:45.931671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:45.932859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:45.933163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:45.934962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:45.941385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 445/912] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:45.946858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:46.038648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048d79-5cf3-46f8-9d27-6d151802f08d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:46.051836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:46.052350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811da3-3cfb-497f-a005-a098324b10d9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:46.089404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341cb86-88cc-4dae-a818-25be11e14a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:46.090040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341cb86-88cc-4dae-a818-25be11e14a10 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.090226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:46.090336 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341cb86-88cc-4dae-a818-25be11e14a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.090576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341cb86-88cc-4dae-a818-25be11e14a10 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.090869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.091143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.091407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.092097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] RBAC: Adding query filter params (interface=public, service_id=d2ffd138435649a58502138234a7faff, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:46.092501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:46.093940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:46.103097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 446/913] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 24 04:48:45 2022] GET /identity/v3/endpoints?service_id=d2ffd138435649a58502138234a7faff&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:46.103381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341cb86-88cc-4dae-a818-25be11e14a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:46.105874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a341cb86-88cc-4dae-a818-25be11e14a10 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:46.110590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:46.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:48:46.113386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:46.116482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 468/914] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Sep 24 04:48:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:46.122768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341cb86-88cc-4dae-a818-25be11e14a10 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:46.134702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:46.222333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bc3c6-569d-48eb-916f-13d89470fabd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:46.260308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341cb86-88cc-4dae-a818-25be11e14a10 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:46.262993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eae1c4-f640-4587-a88d-dbab6d06e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:46.263668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eae1c4-f640-4587-a88d-dbab6d06e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.263944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eae1c4-f640-4587-a88d-dbab6d06e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.264208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eae1c4-f640-4587-a88d-dbab6d06e4f4 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.264804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eae1c4-f640-4587-a88d-dbab6d06e4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:46.266146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eae1c4-f640-4587-a88d-dbab6d06e4f4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:46.283180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 447/915] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:48:46 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 04:48:46.304181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:46.305223 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.305725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.306202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.307166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:46.307702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:46.309404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:46.320448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 469/916] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Sep 24 04:48:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:46.325751 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eae1c4-f640-4587-a88d-dbab6d06e4f4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:46.430646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:46.448353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eae1c4-f640-4587-a88d-dbab6d06e4f4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:46.493114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f7e9-4383-49c5-bcc1-19b2692feb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:46.493766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f7e9-4383-49c5-bcc1-19b2692feb67 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.494039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f7e9-4383-49c5-bcc1-19b2692feb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.494304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f7e9-4383-49c5-bcc1-19b2692feb67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.506474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f7e9-4383-49c5-bcc1-19b2692feb67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:46.507926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f7e9-4383-49c5-bcc1-19b2692feb67 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a804f7e9-4383-49c5-bcc1-19b2692feb67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:46.523089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:46.524089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:46.524975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:46.524975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:46.524975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:46.524975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 448/917] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:46.531383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:46.561082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:46.604696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d278e7-b323-4632-bca9-ad8e90435c06 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.605103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d278e7-b323-4632-bca9-ad8e90435c06 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.605494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d278e7-b323-4632-bca9-ad8e90435c06 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.607454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 449/918] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:46.612877 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fbbf0-4753-4ad4-86d5-6a2b4a7a6862 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.613248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fbbf0-4753-4ad4-86d5-6a2b4a7a6862 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.613640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fbbf0-4753-4ad4-86d5-6a2b4a7a6862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.636578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-712fbbf0-4753-4ad4-86d5-6a2b4a7a6862 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:46.637752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-712fbbf0-4753-4ad4-86d5-6a2b4a7a6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:46.643469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7c15-c1e4-4118-8b74-01180ca04572 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:46.691112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:46.692090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.692606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.694200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.695104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:46.695625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:46.698167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:46.716501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 470/919] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:46.721460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:46.725218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 450/920] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:46.811652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:46.828239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc00c24-d2ae-470a-850a-37f7679c2685 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:46.865278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:46.866291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:46.866806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:46.867274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:46.875017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:46.876655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:46.888508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:46.889448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:46.890366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:46.892818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 471/921] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:48:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:46.902442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fbbf0-4753-4ad4-86d5-6a2b4a7a6862 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:46.971305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:47.002568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.014642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fbbf0-4753-4ad4-86d5-6a2b4a7a6862 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.064415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.065684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.066418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.066896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.068042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:47.068929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.070829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.095180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 451/922] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Sep 24 04:48:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:47.101318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.114453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb803f-fc81-43dc-bd93-c8649d4af2c3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.150249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.151315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.151809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.152291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.153061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.154860 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:47.165006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:47.166033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 04:48:47.166894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:47.174391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 472/923] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:47.175489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.188585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:47.219965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abddae2-61a1-4683-b9e1-5c7c6945d335 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.258244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:47.268469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.269099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.269372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.269635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.281996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.283759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.293453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd74ec-3089-4c46-baa8-2f0a40c265b6 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:47.302517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:47.303617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:47.304505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:47.304505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:47.304505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:47.309264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 452/924] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:47.310186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.347629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.348611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.349089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.349960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.351492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:47.351800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.353162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.359923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 473/925] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:47.367181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.431899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e915a06-c101-4ce7-8e3e-08d50c1d6e33 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.469645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.470244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.470516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.470822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.471456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:47.471753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.473088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.473199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:47.489452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 453/926] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:47.496789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.513506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3e77-0477-4696-9418-02623c3667ce None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.542684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:47.560090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.561268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.561751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.562359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.563662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:47.564277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.566362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.573132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 474/927] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 24 04:48:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:47.579221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.613076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83ddd-354b-43d5-8881-1f9da70e0444 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.655494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.656156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.656428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.656695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.667591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.669060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:47.681682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:47.682669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:47.683606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:47.683606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:47.683606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:47.683606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:47.683606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:47.683606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:47.683606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:47.683606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:47.687831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 454/928] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:47.688809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.721973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ca3d-0e68-414f-bc3f-5e13485c6fd1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.758634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e1acd-7829-486e-80ef-16942fa5506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.758998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e1acd-7829-486e-80ef-16942fa5506d None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.759276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e1acd-7829-486e-80ef-16942fa5506d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.759546 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e1acd-7829-486e-80ef-16942fa5506d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.760362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e1acd-7829-486e-80ef-16942fa5506d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.761719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e1acd-7829-486e-80ef-16942fa5506d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.772267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:47.784582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 475/929] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:48:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:47.785936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b060f-0efe-4456-92fa-cd22a4b3df1a None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.786225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b060f-0efe-4456-92fa-cd22a4b3df1a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.786494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b060f-0efe-4456-92fa-cd22a4b3df1a None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.793462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 476/930] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:47.795381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab8f8-40c5-46f2-b3fa-06e59479ae6b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.795736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab8f8-40c5-46f2-b3fa-06e59479ae6b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.796075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab8f8-40c5-46f2-b3fa-06e59479ae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.814209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:47.818223 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b6bab8f8-40c5-46f2-b3fa-06e59479ae6b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:47.819585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1f00-9495-4cb3-a89f-30d6f26aca53 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:47.820694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6bab8f8-40c5-46f2-b3fa-06e59479ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:47.872121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:47.873005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:47.874381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:47.874906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:47.875762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:47.876726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:47.878829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:47.896089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 455/931] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:47.902260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:47.913064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 477/932] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:48.021246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba36179-bde9-4573-8b3c-bc03fa179e31 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:48.059702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbd602-d980-4d44-b9a5-ef4f0bb64fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:48.060607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd602-d980-4d44-b9a5-ef4f0bb64fb8 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:48.061080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd602-d980-4d44-b9a5-ef4f0bb64fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:48.061488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd602-d980-4d44-b9a5-ef4f0bb64fb8 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/58adf938f17647108c2d652565bf3e2b/roles/1b00469c884a4dbeb71c91c3bcc4a347` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:48.063919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbd602-d980-4d44-b9a5-ef4f0bb64fb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=58adf938f17647108c2d652565bf3e2b, role_id=1b00469c884a4dbeb71c91c3bcc4a347)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:48.065460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbd602-d980-4d44-b9a5-ef4f0bb64fb8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:48.083137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 456/933] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:48:47 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/58adf938f17647108c2d652565bf3e2b/roles/1b00469c884a4dbeb71c91c3bcc4a347 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:48:48.194993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab8f8-40c5-46f2-b3fa-06e59479ae6b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:48.306542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab8f8-40c5-46f2-b3fa-06e59479ae6b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:48.332102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:48.343955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:48.344587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:48.344862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:48.345135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:48.345722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:48.347134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:48.356793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:48.357791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:48.359078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 478/934] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:48.364087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbd602-d980-4d44-b9a5-ef4f0bb64fb8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:48.391130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:48.476528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbd602-d980-4d44-b9a5-ef4f0bb64fb8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:48.512236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9e892-990a-41d5-a936-d94fbe1498dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:48.512843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e892-990a-41d5-a936-d94fbe1498dc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:48.513117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e892-990a-41d5-a936-d94fbe1498dc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:48.513385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e892-990a-41d5-a936-d94fbe1498dc None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:48.514017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9e892-990a-41d5-a936-d94fbe1498dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:48.514319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9e892-990a-41d5-a936-d94fbe1498dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:48.515689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9e892-990a-41d5-a936-d94fbe1498dc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:48.520911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 457/935] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:48.526434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:48.635914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e0e85-7ce6-4e03-a125-f40c518a29b4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:48.666133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730768a-58a6-42b8-a0db-2b5b2163ab12 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:48.666692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730768a-58a6-42b8-a0db-2b5b2163ab12 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:48.667227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730768a-58a6-42b8-a0db-2b5b2163ab12 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:48.672593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:48.672593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:48.672593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:48.672593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:48.672937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:48.673011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:48.673315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 458/936] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:48:48.674408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:48.675221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ac5e-882e-422b-af6d-a88ec0f5f756 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:48.675713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ac5e-882e-422b-af6d-a88ec0f5f756 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:48.676170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ac5e-882e-422b-af6d-a88ec0f5f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:48.679989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 479/937] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:48.685601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:48.698228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6bf5ac5e-882e-422b-af6d-a88ec0f5f756 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:48.699498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6bf5ac5e-882e-422b-af6d-a88ec0f5f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:48.746082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:48.805491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 459/938] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:48.807042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc3618-c896-45c8-b700-bc719211f7ae None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:48.842985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:48.843591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:48.843866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:48.844135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:48.844899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] RBAC: Adding query filter params (interface=public, service_id=f57388b669ec4f1c90faadf2ad8dd4dc, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:48.845210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:48.846575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:48.854519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 480/939] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 24 04:48:48 2022] GET /identity/v3/endpoints?service_id=f57388b669ec4f1c90faadf2ad8dd4dc&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:48.860221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ac5e-882e-422b-af6d-a88ec0f5f756 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:48.887183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:48.962633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ac5e-882e-422b-af6d-a88ec0f5f756 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:48.997814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a343fef-a8c4-41e1-8f47-0fa31ac44c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:48.998435 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a343fef-a8c4-41e1-8f47-0fa31ac44c65 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:48.998996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a343fef-a8c4-41e1-8f47-0fa31ac44c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:48.999263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a343fef-a8c4-41e1-8f47-0fa31ac44c65 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:48.999883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a343fef-a8c4-41e1-8f47-0fa31ac44c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:49.001343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a343fef-a8c4-41e1-8f47-0fa31ac44c65 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:49.008686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 460/940] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:48:48 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 04:48:49.090819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:49.205495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7236c23-1729-4219-94d5-8d8bdd6ceb41 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:49.222957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:49.243261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:49.243894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:49.244179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:49.244449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:49.245033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:49.246468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:49.255779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:49.257957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:49.259120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 481/941] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Sep 24 04:48:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:49.266057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a343fef-a8c4-41e1-8f47-0fa31ac44c65 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:49.343163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:49.376854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a343fef-a8c4-41e1-8f47-0fa31ac44c65 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:49.413816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:49.414417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:49.414689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:49.414980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:49.415601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:49.415900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:49.417235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:49.422241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 461/942] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:49.428100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:49.530261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ca10-a4fb-46a0-b499-910d433cf972 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:49.570389 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef393be-04b6-4b98-a379-162b61005496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:49.571025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef393be-04b6-4b98-a379-162b61005496 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:49.571301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef393be-04b6-4b98-a379-162b61005496 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:49.571569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef393be-04b6-4b98-a379-162b61005496 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:49.572204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef393be-04b6-4b98-a379-162b61005496 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:49.572501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef393be-04b6-4b98-a379-162b61005496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:49.573864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef393be-04b6-4b98-a379-162b61005496 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:49.579111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 482/943] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:49.588092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:49.708259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927b0e-f39e-4e9c-b9fc-c8dd8c7a8680 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:49.743954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822b9c1-58a6-45dd-9d3d-748e9aa21b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:49.744552 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822b9c1-58a6-45dd-9d3d-748e9aa21b77 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:49.744827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822b9c1-58a6-45dd-9d3d-748e9aa21b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:49.745089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822b9c1-58a6-45dd-9d3d-748e9aa21b77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:49.745752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822b9c1-58a6-45dd-9d3d-748e9aa21b77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:49.747110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822b9c1-58a6-45dd-9d3d-748e9aa21b77 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:49.756049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:49.775655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 462/944] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:48:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:50.152258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1689086-a838-495c-8f37-84f305ea9436 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:50.152649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1689086-a838-495c-8f37-84f305ea9436 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:50.152852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1689086-a838-495c-8f37-84f305ea9436 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:50.154403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 483/945] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:50.159777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82beae8-9a3f-4e24-875b-d785139e3cc7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:50.160062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82beae8-9a3f-4e24-875b-d785139e3cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:50.160339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82beae8-9a3f-4e24-875b-d785139e3cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:50.179970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e82beae8-9a3f-4e24-875b-d785139e3cc7 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:50.181159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e82beae8-9a3f-4e24-875b-d785139e3cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:50.261609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 463/946] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:50.352806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c336a9-d2c6-4e0c-9dac-12bbaa61e37b None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:50.353344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c336a9-d2c6-4e0c-9dac-12bbaa61e37b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:50.353344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c336a9-d2c6-4e0c-9dac-12bbaa61e37b None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:50.354897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 484/947] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:50.360191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5f54-4230-48d9-8550-45b6d092ebee None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:50.360605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5f54-4230-48d9-8550-45b6d092ebee None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:50.360702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5f54-4230-48d9-8550-45b6d092ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:50.379535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-293a5f54-4230-48d9-8550-45b6d092ebee None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:50.380832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-293a5f54-4230-48d9-8550-45b6d092ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:50.448255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 464/948] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:50.556387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c336a9-d2c6-4e0c-9dac-12bbaa61e37b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:50.605533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:50.667103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c336a9-d2c6-4e0c-9dac-12bbaa61e37b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:50.702080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:50.702599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:50.702906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:50.703177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:50.703827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:50.705244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:50.707860 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING keystone.server.flask.common [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 04:48:50.720263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5f54-4230-48d9-8550-45b6d092ebee None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:50.726721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.sql.core [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 04:48:50.726721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 04:48:50.726721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [parameters: {'id': '76e6f5a8cc5c4b2f964a0f77e9bb86f6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 04:48:50.726721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 76e6f5a8cc5c4b2f964a0f77e9bb86f6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 76e6f5a8cc5c4b2f964a0f77e9bb86f6. Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 04:48:50.734426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 24 04:48:50.735330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application yield resource Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application next(self.gen) Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise self.value Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application session.commit() Sep 24 04:48:50.736316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.session.flush() Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application compat.raise_( Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 04:48:50.737282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 04:48:50.738200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application conn.query(q) Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application result.read() Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 04:48:50.740572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [parameters: {'id': '76e6f5a8cc5c4b2f964a0f77e9bb86f6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:50.743830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:50.746286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 76e6f5a8cc5c4b2f964a0f77e9bb86f6. Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 485/949] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Sep 24 04:48:50 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:50.748882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:50.784978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:50.843280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5f54-4230-48d9-8550-45b6d092ebee None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:50.862450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:50.865760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01021686-a7fd-4e79-81a9-177582ba2a65 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:50.882945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01ebb-804d-498f-b87f-5fd57a620ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:50.883570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01ebb-804d-498f-b87f-5fd57a620ced None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:50.883840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01ebb-804d-498f-b87f-5fd57a620ced None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:50.884104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01ebb-804d-498f-b87f-5fd57a620ced None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:50.895248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe01ebb-804d-498f-b87f-5fd57a620ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0fe01ebb-804d-498f-b87f-5fd57a620ced None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:48:50.900304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:50.901230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:48:50.902062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:50.903234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:50.906773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:50.906773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:50.906773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:50.907010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 465/950] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Sep 24 04:48:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:50.907374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01ebb-804d-498f-b87f-5fd57a620ced None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:50.911412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:50.913618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:50.925262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:50.927088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:50.928406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 486/951] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:50.936524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:51.043882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01ebb-804d-498f-b87f-5fd57a620ced None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:51.057099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:51.065646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715d43-e2cc-4d3a-a57d-faaa605f4ece None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:51.090681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:51.092535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.093085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.093536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.094339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:51.094961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:51.097084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:51.109091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 466/952] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Sep 24 04:48:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:51.109294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:51.110089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.110435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.114812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.114812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:51.114812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:51.114812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:51.117053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:51.143433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 487/953] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:51.243031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634068cc-6170-4200-a260-6924a7070ce6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:51.280728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5280508-2834-4c76-bfe4-45a28f52fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:51.281359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280508-2834-4c76-bfe4-45a28f52fe74 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.281632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280508-2834-4c76-bfe4-45a28f52fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.281897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280508-2834-4c76-bfe4-45a28f52fe74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.295585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5280508-2834-4c76-bfe4-45a28f52fe74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:51.297007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5280508-2834-4c76-bfe4-45a28f52fe74 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f5280508-2834-4c76-bfe4-45a28f52fe74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:51.312982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:51.314050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:51.315784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:51.315784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:51.315784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:51.315784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 467/954] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:51.320563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:51.327941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9474-9139-40e3-af21-ddb41f066588 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.328263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9474-9139-40e3-af21-ddb41f066588 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.328469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9474-9139-40e3-af21-ddb41f066588 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.330065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 468/955] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:48:51.335826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7b3e-8e37-4b42-bde8-8d301ef3a34d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.336074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7b3e-8e37-4b42-bde8-8d301ef3a34d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.336348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7b3e-8e37-4b42-bde8-8d301ef3a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.353095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:51.357091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-50ff7b3e-8e37-4b42-bde8-8d301ef3a34d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:51.358271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-50ff7b3e-8e37-4b42-bde8-8d301ef3a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:51.378884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:51.450826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 469/956] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:51.462148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822cf6b-4292-4b31-9e30-9faf4ccd789d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:51.498346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:51.499255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.499527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.499790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.500430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:51.500735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:51.502077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:51.514815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 488/957] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:51.520504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff7b3e-8e37-4b42-bde8-8d301ef3a34d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:51.626592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff7b3e-8e37-4b42-bde8-8d301ef3a34d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:51.663281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:51.664024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.664303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.664568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.672364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:51.673922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:51.688319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:51.689378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:51.690571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 470/958] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:48:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:51.696350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:51.727565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:51.743774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:51.791373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:51.812560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa377f8-a8ba-4961-9ae8-0fe8c66bf81c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:51.849950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa612a6-5c68-4001-b6cf-83464460c9c5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:51.850525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:51.851224 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.851501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.851770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.852677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:51.852983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:51.855274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:51.878871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 489/959] 10.222.0.26 () {56 vars in 1149 bytes} [Sat Sep 24 04:48:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:51.885172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:51.896456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:51.897281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:51.897698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:51.897969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:51.898548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:51.899958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:51.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:51.909894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:51.910799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 471/960] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:51.918871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:52.008549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:52.029740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3f23e-710c-47e0-8ea8-8335ea423659 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.035706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a5104-31d5-413d-ad2c-b4c70bb014c2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.072850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b9540-df9e-4fab-b863-ad3995589359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:52.073456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9540-df9e-4fab-b863-ad3995589359 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.073734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9540-df9e-4fab-b863-ad3995589359 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.074014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9540-df9e-4fab-b863-ad3995589359 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.074634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b9540-df9e-4fab-b863-ad3995589359 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:52.074959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b9540-df9e-4fab-b863-ad3995589359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:52.075660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90d39a-8998-4398-8203-b3d40db52d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:52.076311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b9540-df9e-4fab-b863-ad3995589359 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:52.076609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d39a-8998-4398-8203-b3d40db52d23 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.077035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d39a-8998-4398-8203-b3d40db52d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.077452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d39a-8998-4398-8203-b3d40db52d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.082315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 472/961] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:52.083515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ec0b7-d36b-4f38-8e6d-671faeb0a2bb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.083796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ec0b7-d36b-4f38-8e6d-671faeb0a2bb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.084595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ec0b7-d36b-4f38-8e6d-671faeb0a2bb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.088353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:52.090315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 473/962] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:52.091179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ec0b7-d36b-4f38-8e6d-671faeb0a2bb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:52.153059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90d39a-8998-4398-8203-b3d40db52d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:52.154426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90d39a-8998-4398-8203-b3d40db52d23 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:52.201283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ec0b7-d36b-4f38-8e6d-671faeb0a2bb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.239620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c5a8-eea1-4198-a80b-71a47a27674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:52.241077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c5a8-eea1-4198-a80b-71a47a27674f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.241355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c5a8-eea1-4198-a80b-71a47a27674f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.241624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c5a8-eea1-4198-a80b-71a47a27674f None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.242316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c5a8-eea1-4198-a80b-71a47a27674f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:52.242626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c5a8-eea1-4198-a80b-71a47a27674f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:52.244016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c5a8-eea1-4198-a80b-71a47a27674f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:52.249936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 474/963] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:52.251135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3005-5b5c-4b97-917c-9f3d4300f0e8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.251416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3005-5b5c-4b97-917c-9f3d4300f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.251688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3005-5b5c-4b97-917c-9f3d4300f0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.259163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:52.270929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c7fa3005-5b5c-4b97-917c-9f3d4300f0e8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:52.276546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7fa3005-5b5c-4b97-917c-9f3d4300f0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:52.276686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 490/964] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:48:51 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:48:52.276686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90d39a-8998-4398-8203-b3d40db52d23 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:52.320150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:52.354920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 475/965] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:52.354920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3005-5b5c-4b97-917c-9f3d4300f0e8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:52.383758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90d39a-8998-4398-8203-b3d40db52d23 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.420026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700805-374b-45f2-acd7-a3a14fd2f6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:52.421225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700805-374b-45f2-acd7-a3a14fd2f6d9 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.421946 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700805-374b-45f2-acd7-a3a14fd2f6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.422369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700805-374b-45f2-acd7-a3a14fd2f6d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.423401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6700805-374b-45f2-acd7-a3a14fd2f6d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:52.425483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6700805-374b-45f2-acd7-a3a14fd2f6d9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:52.453594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 491/966] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:48:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:52.480470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3005-5b5c-4b97-917c-9f3d4300f0e8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.521869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:52.528246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:52.529134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.529291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.529570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.547688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:52.549359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:48:52.567096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:52.568292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:48:52.569448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:48:52.569448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:48:52.569448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:52.569448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 476/967] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:52.574544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700805-374b-45f2-acd7-a3a14fd2f6d9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:52.666940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:52.690634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:52.699812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700805-374b-45f2-acd7-a3a14fd2f6d9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.742076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:52.742910 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.743260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.743592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.744299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:52.744668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:52.746116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:52.759732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 492/968] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:52.767736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:52.799238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40715d27-a277-492f-ae8f-6555545293c6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.837155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:52.837954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.838082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.838299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.838957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:52.840305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:52.849476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:52.851144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:52.852009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 477/969] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:52.858607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:52.910999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:52.922714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c126ca-731f-40fa-a579-4fc44103044d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.960550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:52.961093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:52.961368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:52.961637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:52.968560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:52.970172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:52.981563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a3b27-5780-43e6-88a5-2012f8dbe7cb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:48:52.982021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:52.982924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:52.983857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:48:52.983857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:48:52.983857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:48:52.983857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:48:52.983857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:48:52.983857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:48:52.983857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:48:52.983857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:52.988222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 493/970] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:52.989081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:53.007344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:53.032279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:53.033263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:53.033776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:53.034777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:53.035624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:53.036567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:53.039537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:53.051443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 478/971] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:53.053596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:53.101854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c2238-1a04-4cb7-b1ed-ccea50ca7c97 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:53.137737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:53.138249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:53.138528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:53.138832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:53.139601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:53.139897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:53.141329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:53.159103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 494/972] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:53.160633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:53.195692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ba99f-9b47-48be-8006-0c7d0ad101bb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:53.210976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:53.243173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:53.246135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2a30a-dae4-486f-9ad9-7092091283fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:53.247114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a30a-dae4-486f-9ad9-7092091283fc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:53.248175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a30a-dae4-486f-9ad9-7092091283fc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:53.249640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a30a-dae4-486f-9ad9-7092091283fc None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:53.250475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a30a-dae4-486f-9ad9-7092091283fc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:53.251343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a30a-dae4-486f-9ad9-7092091283fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:53.253800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a30a-dae4-486f-9ad9-7092091283fc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:53.267111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 479/973] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:53.280085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b5af-4f05-4e69-8ffd-1e35e0d99ec1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:53.320765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eadce6-0dfb-4bb3-922e-e9e9fe95fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:53.321375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eadce6-0dfb-4bb3-922e-e9e9fe95fafc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:53.321646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eadce6-0dfb-4bb3-922e-e9e9fe95fafc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:53.321911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eadce6-0dfb-4bb3-922e-e9e9fe95fafc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:53.322641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eadce6-0dfb-4bb3-922e-e9e9fe95fafc None admin] RBAC: Adding query filter params (role.id=1b00469c884a4dbeb71c91c3bcc4a347, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=58adf938f17647108c2d652565bf3e2b) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:53.322977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eadce6-0dfb-4bb3-922e-e9e9fe95fafc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:53.324481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eadce6-0dfb-4bb3-922e-e9e9fe95fafc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:53.331670 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 495/974] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:48:53 2022] GET /identity/v3/role_assignments?user.id=58adf938f17647108c2d652565bf3e2b&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=1b00469c884a4dbeb71c91c3bcc4a347 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:53.534002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859aaa-2f42-4280-841f-d52faabbf8ef None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:53.534543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859aaa-2f42-4280-841f-d52faabbf8ef None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:53.534543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859aaa-2f42-4280-841f-d52faabbf8ef None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:53.535885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 480/975] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:53.541451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069529-8809-4ae3-9d2d-8377d6c2340d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:53.541909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069529-8809-4ae3-9d2d-8377d6c2340d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:53.542108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44069529-8809-4ae3-9d2d-8377d6c2340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:53.562296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-44069529-8809-4ae3-9d2d-8377d6c2340d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:53.563842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-44069529-8809-4ae3-9d2d-8377d6c2340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:53.637907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 496/976] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:53.913829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b859aaa-2f42-4280-841f-d52faabbf8ef None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:54.020224 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b859aaa-2f42-4280-841f-d52faabbf8ef None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:54.055513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:54.056123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:54.056768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:54.057054 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:54.057712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:54.059160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:54.061813 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING keystone.server.flask.common [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 04:48:54.075741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.sql.core [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 04:48:54.075741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 04:48:54.075741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [parameters: {'user_id': '6d64f9715c9b49e39392a42d45434378', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 04:48:54.075741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Sep 24 04:48:54.095344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 04:48:54.096272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application yield resource Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise self.value Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application session.commit() Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 04:48:54.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.flush() Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application compat.raise_( Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 04:48:54.098810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 04:48:54.100997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 04:48:54.111412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [parameters: {'user_id': '6d64f9715c9b49e39392a42d45434378', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:54.113410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 24 04:48:54.115835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 24 04:48:54.117200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 24 04:48:54.117200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 24 04:48:54.117200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 04:48:54.117200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 04:48:54.117200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 04:48:54.117200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:54.117200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 481/977] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 24 04:48:53 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:54.117993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44069529-8809-4ae3-9d2d-8377d6c2340d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:54.195226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:54.212845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44069529-8809-4ae3-9d2d-8377d6c2340d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:54.252003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95e2d-ee0e-4ad9-ab2a-eecdf286e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:54.252676 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95e2d-ee0e-4ad9-ab2a-eecdf286e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:54.252962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95e2d-ee0e-4ad9-ab2a-eecdf286e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:54.253232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95e2d-ee0e-4ad9-ab2a-eecdf286e0e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:54.261385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca95e2d-ee0e-4ad9-ab2a-eecdf286e0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:54.262857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca95e2d-ee0e-4ad9-ab2a-eecdf286e0e1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-bca95e2d-ee0e-4ad9-ab2a-eecdf286e0e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:48:54.275301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:54.277464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 04:48:54.279691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:54.282780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:54.292619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 497/978] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:48:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:54.325609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:54.398565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec262ce9-b1f0-47c4-ae20-e6a070cee853 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:54.433585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf038b-c087-457f-9def-7ee46e2a9844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:54.434180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf038b-c087-457f-9def-7ee46e2a9844 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:54.434454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf038b-c087-457f-9def-7ee46e2a9844 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:54.434723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf038b-c087-457f-9def-7ee46e2a9844 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:54.435503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf038b-c087-457f-9def-7ee46e2a9844 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:54.435804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf038b-c087-457f-9def-7ee46e2a9844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:54.437525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf038b-c087-457f-9def-7ee46e2a9844 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:54.477429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 482/979] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 24 04:48:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:54.736886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899b98-6164-463d-adde-3316f696e9eb None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:54.737380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899b98-6164-463d-adde-3316f696e9eb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:54.737473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899b98-6164-463d-adde-3316f696e9eb None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:54.738962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 498/980] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:54.745007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847ba5-2762-4ddd-bff4-593c4511d9c3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:54.745878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847ba5-2762-4ddd-bff4-593c4511d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:54.746375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847ba5-2762-4ddd-bff4-593c4511d9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:54.767895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ff847ba5-2762-4ddd-bff4-593c4511d9c3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:54.769420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff847ba5-2762-4ddd-bff4-593c4511d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:54.839162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 483/981] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:55.108042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab899b98-6164-463d-adde-3316f696e9eb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:55.212633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab899b98-6164-463d-adde-3316f696e9eb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:55.239533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:55.248287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:55.249176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.249455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.249729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.250317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:55.251742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:55.261414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:55.262433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:55.263899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 499/982] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:55.268399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847ba5-2762-4ddd-bff4-593c4511d9c3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:55.294884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:55.373543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847ba5-2762-4ddd-bff4-593c4511d9c3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:55.408205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5003b46-2db2-482a-9c62-5e3b026366d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:55.408811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5003b46-2db2-482a-9c62-5e3b026366d4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.409085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5003b46-2db2-482a-9c62-5e3b026366d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.409355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5003b46-2db2-482a-9c62-5e3b026366d4 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.409981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5003b46-2db2-482a-9c62-5e3b026366d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:55.410284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5003b46-2db2-482a-9c62-5e3b026366d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:55.411657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5003b46-2db2-482a-9c62-5e3b026366d4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:55.421589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 484/983] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:55.423437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:55.531896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75221c4-ec0a-4f89-97f4-b6afa3e5f562 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:55.545684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ee4a-aee3-4492-99c5-0408af8035fd None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.545984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ee4a-aee3-4492-99c5-0408af8035fd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.546305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ee4a-aee3-4492-99c5-0408af8035fd None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.547795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 485/984] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:48:55.552541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a6dbb-e6a1-4197-8dc6-05e60efadefd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.552848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a6dbb-e6a1-4197-8dc6-05e60efadefd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.553193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a6dbb-e6a1-4197-8dc6-05e60efadefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.570096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:55.570999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.571275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8a1a6dbb-e6a1-4197-8dc6-05e60efadefd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:55.571588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.572007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.572443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8a1a6dbb-e6a1-4197-8dc6-05e60efadefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:55.572971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:55.573422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:55.575016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:55.580077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 500/985] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:55.587018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:55.643928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:55.649158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 486/986] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:55.650711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd62b2-edfa-41e1-8e04-db54688c3d80 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.651228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd62b2-edfa-41e1-8e04-db54688c3d80 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.651559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd62b2-edfa-41e1-8e04-db54688c3d80 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.652986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 487/987] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:55.658112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e21a-b454-4eca-9707-41aa27b518c9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.658388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e21a-b454-4eca-9707-41aa27b518c9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.658662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e21a-b454-4eca-9707-41aa27b518c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.676358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-89a2e21a-b454-4eca-9707-41aa27b518c9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:55.677536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-89a2e21a-b454-4eca-9707-41aa27b518c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:55.691259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:55.698612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f00e-b1fa-4db4-9059-cca823eab747 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:55.739791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:55.741145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.741260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.741435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.742140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] RBAC: Adding query filter params (interface=admin, service_id=f57388b669ec4f1c90faadf2ad8dd4dc, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:55.742444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:55.743839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:55.753659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 501/988] 10.222.0.26 () {56 vars in 1249 bytes} [Sat Sep 24 04:48:55 2022] GET /identity/v3/endpoints?service_id=f57388b669ec4f1c90faadf2ad8dd4dc&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:55.753831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 488/989] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:48:55.754664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:55.852336 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6c2f7-2f13-4c01-8985-8bc107821336 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:55.871332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:55.886468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57175f-21b6-4e29-9f85-28710b646054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:55.887089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57175f-21b6-4e29-9f85-28710b646054 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:55.887365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57175f-21b6-4e29-9f85-28710b646054 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:55.887632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57175f-21b6-4e29-9f85-28710b646054 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:55.888228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57175f-21b6-4e29-9f85-28710b646054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:55.889580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57175f-21b6-4e29-9f85-28710b646054 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:55.903152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 502/990] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:48:55 2022] GET /identity/v3/services => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 04:48:55.921801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e21a-b454-4eca-9707-41aa27b518c9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:56.023877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57175f-21b6-4e29-9f85-28710b646054 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:56.029157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e21a-b454-4eca-9707-41aa27b518c9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:56.069839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c437b-ce2a-4ebe-95c8-bb19634f3eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:56.070468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c437b-ce2a-4ebe-95c8-bb19634f3eec None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:56.071104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c437b-ce2a-4ebe-95c8-bb19634f3eec None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:56.071383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c437b-ce2a-4ebe-95c8-bb19634f3eec None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:56.072233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c437b-ce2a-4ebe-95c8-bb19634f3eec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:56.073623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c437b-ce2a-4ebe-95c8-bb19634f3eec None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:56.090209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 489/991] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:48:55 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:56.140331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57175f-21b6-4e29-9f85-28710b646054 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:56.187639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:56.188184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:56.188456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:56.188721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] PATH_INFO: `/v3/services/image` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:56.189305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:56.190673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:56.200484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:56.201577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:56.202446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 503/992] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Sep 24 04:48:56 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:48:56.208765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c437b-ce2a-4ebe-95c8-bb19634f3eec None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:56.221514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:56.325924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c437b-ce2a-4ebe-95c8-bb19634f3eec None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:56.361400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99470ee9-62bf-4824-9d29-bfa1fc1bb26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:56.361995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470ee9-62bf-4824-9d29-bfa1fc1bb26c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:56.362265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470ee9-62bf-4824-9d29-bfa1fc1bb26c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:56.362529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99470ee9-62bf-4824-9d29-bfa1fc1bb26c None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:56.363169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470ee9-62bf-4824-9d29-bfa1fc1bb26c None admin] RBAC: Adding query filter params (name=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:56.363467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470ee9-62bf-4824-9d29-bfa1fc1bb26c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:56.364797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99470ee9-62bf-4824-9d29-bfa1fc1bb26c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:56.374540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 490/993] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:56.375818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:56.425302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:56.482097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd96f10-68a9-4057-82c7-b1a5dd5e3252 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:56.516173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580f9ef-e209-4942-b1b6-fbddf01568b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:56.516768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580f9ef-e209-4942-b1b6-fbddf01568b4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:56.517039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580f9ef-e209-4942-b1b6-fbddf01568b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:56.517301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580f9ef-e209-4942-b1b6-fbddf01568b4 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:56.517917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580f9ef-e209-4942-b1b6-fbddf01568b4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:56.518213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580f9ef-e209-4942-b1b6-fbddf01568b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:56.519589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580f9ef-e209-4942-b1b6-fbddf01568b4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:56.530788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 504/994] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:48:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:58.111897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f48e6-892d-4528-9975-d2253bb95ee5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.112429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f48e6-892d-4528-9975-d2253bb95ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.112429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f48e6-892d-4528-9975-d2253bb95ee5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.113899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 491/995] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:58.119720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7969-2ad5-49e5-9fb8-7e83be68cb04 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.120148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7969-2ad5-49e5-9fb8-7e83be68cb04 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.120237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7969-2ad5-49e5-9fb8-7e83be68cb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.139167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f5fe7969-2ad5-49e5-9fb8-7e83be68cb04 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:58.140338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f5fe7969-2ad5-49e5-9fb8-7e83be68cb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:58.220244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 505/996] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:58.283644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1356ee-f534-4a24-87b3-745b59ef51ec None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.283983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1356ee-f534-4a24-87b3-745b59ef51ec None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.284187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1356ee-f534-4a24-87b3-745b59ef51ec None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.285657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 492/997] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:58.291313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72e002-68c5-492b-8229-d2b395a9d160 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.291817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72e002-68c5-492b-8229-d2b395a9d160 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.291986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72e002-68c5-492b-8229-d2b395a9d160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.310454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4d72e002-68c5-492b-8229-d2b395a9d160 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:58.311695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4d72e002-68c5-492b-8229-d2b395a9d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:58.343050 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:58.382038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 506/998] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:58.500326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1356ee-f534-4a24-87b3-745b59ef51ec None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:58.576348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:58.612242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1356ee-f534-4a24-87b3-745b59ef51ec None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:58.649651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:58.650293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.650574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.650899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.651073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72e002-68c5-492b-8229-d2b395a9d160 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:58.651451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:58.652793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:58.667931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:58.668916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:48:58.671564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 493/999] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 24 04:48:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:58.675705 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:58.754624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72e002-68c5-492b-8229-d2b395a9d160 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:58.774050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e624881-d79c-4fb5-a060-72e35b21f7a2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:58.789104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4967ec-d5a2-4594-befe-0fd6469f369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:58.789719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4967ec-d5a2-4594-befe-0fd6469f369a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.789995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4967ec-d5a2-4594-befe-0fd6469f369a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.790260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4967ec-d5a2-4594-befe-0fd6469f369a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.790864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4967ec-d5a2-4594-befe-0fd6469f369a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:58.792225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4967ec-d5a2-4594-befe-0fd6469f369a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cc4967ec-d5a2-4594-befe-0fd6469f369a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:48:58.800809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:48:58.801799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:48:58.802659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 507/1000] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:48:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:48:58.804078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1776d-e62e-4b0a-be93-32447f7fdfc1 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.804078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1776d-e62e-4b0a-be93-32447f7fdfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.804078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1776d-e62e-4b0a-be93-32447f7fdfc1 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.804984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 508/1001] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:48:58.807733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1776d-e62e-4b0a-be93-32447f7fdfc1 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:58.812997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03427edf-ce67-4ffd-bd0a-7782c7071f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:58.813597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03427edf-ce67-4ffd-bd0a-7782c7071f8c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.813874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03427edf-ce67-4ffd-bd0a-7782c7071f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.814236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03427edf-ce67-4ffd-bd0a-7782c7071f8c None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.814896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03427edf-ce67-4ffd-bd0a-7782c7071f8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:58.815203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03427edf-ce67-4ffd-bd0a-7782c7071f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:58.816545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03427edf-ce67-4ffd-bd0a-7782c7071f8c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:58.818394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:58.821872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 494/1002] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:58.823075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a59ed-73d0-46d8-83d8-7b4249d777a1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.823609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a59ed-73d0-46d8-83d8-7b4249d777a1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.823999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a59ed-73d0-46d8-83d8-7b4249d777a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.842072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3c7a59ed-73d0-46d8-83d8-7b4249d777a1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:48:58.843284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c7a59ed-73d0-46d8-83d8-7b4249d777a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:48:58.846125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:58.908718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 495/1003] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:48:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:48:58.909544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a59ed-73d0-46d8-83d8-7b4249d777a1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:58.917413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1776d-e62e-4b0a-be93-32447f7fdfc1 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:58.954251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:58.954887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:58.955164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:58.955430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:58.956054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:58.956353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:58.957706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:58.962887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 509/1004] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:58.968586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:59.016875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a59ed-73d0-46d8-83d8-7b4249d777a1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:59.046622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:59.053336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:59.053935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:59.054211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:59.054528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:59.055135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:59.055434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:59.056785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:59.062197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 496/1005] 10.222.0.26 () {56 vars in 1122 bytes} [Sat Sep 24 04:48:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:48:59.067150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:59.067794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:59.075596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75626190-9158-4947-93e8-cbbe5ec5257a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:59.113171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:59.113926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:59.114204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:59.114473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:59.115170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:59.115538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:59.117042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:59.121861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 510/1006] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:48:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:59.128523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:59.176949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba531c7-792d-40ff-b112-4b0ab95f6e3c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:59.212242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bccbf-7026-4726-8258-1a782ae6aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:59.212830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bccbf-7026-4726-8258-1a782ae6aa55 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:59.213099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bccbf-7026-4726-8258-1a782ae6aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:59.213363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bccbf-7026-4726-8258-1a782ae6aa55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:59.214014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bccbf-7026-4726-8258-1a782ae6aa55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:59.215402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bccbf-7026-4726-8258-1a782ae6aa55 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:59.230114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896cae-c215-4ab2-a2b7-361251ba99d3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:59.231777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 497/1007] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:48:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:48:59.232733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bccbf-7026-4726-8258-1a782ae6aa55 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:59.291883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:59.292526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:59.292883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:59.293279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:59.294076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] RBAC: Adding query filter params (interface=public, service_id=59ba5e52a12c4a05b74175f6131eb86e, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:48:59.294508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:59.294666 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:59.296202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:59.302162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 511/1008] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 24 04:48:59 2022] GET /identity/v3/endpoints?service_id=59ba5e52a12c4a05b74175f6131eb86e&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:48:59.308144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:48:59.332028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:48:59.351793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bccbf-7026-4726-8258-1a782ae6aa55 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:59.393180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59790dca-55d2-4358-8d90-f39ec15b05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:59.393798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59790dca-55d2-4358-8d90-f39ec15b05bd None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:59.394076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59790dca-55d2-4358-8d90-f39ec15b05bd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:59.394470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59790dca-55d2-4358-8d90-f39ec15b05bd None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:59.395165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59790dca-55d2-4358-8d90-f39ec15b05bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:59.397289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59790dca-55d2-4358-8d90-f39ec15b05bd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:59.417722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 498/1009] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:48:59 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:48:59.427154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c1b64-e905-4dcf-803e-1c0ed1418bbb None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:48:59.478559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f37c0-1710-422e-b9c1-c0cac971dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:48:59.479315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f37c0-1710-422e-b9c1-c0cac971dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:48:59.479657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f37c0-1710-422e-b9c1-c0cac971dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:48:59.480093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f37c0-1710-422e-b9c1-c0cac971dbf0 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:48:59.480710 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f37c0-1710-422e-b9c1-c0cac971dbf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:48:59.482125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f37c0-1710-422e-b9c1-c0cac971dbf0 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:48:59.498036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 512/1010] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:48:59 2022] GET /identity/v3/services => generated 1957 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 04:49:01.450990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043ae6-ce1f-47b0-8fc0-c2b006e56728 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:01.451557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043ae6-ce1f-47b0-8fc0-c2b006e56728 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:01.451557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043ae6-ce1f-47b0-8fc0-c2b006e56728 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:01.453024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 499/1011] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:01.458037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2de91-2223-401d-bc53-e354a0d0cca2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:01.458426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2de91-2223-401d-bc53-e354a0d0cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:01.458616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2de91-2223-401d-bc53-e354a0d0cca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:01.477181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1dc2de91-2223-401d-bc53-e354a0d0cca2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:01.478363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1dc2de91-2223-401d-bc53-e354a0d0cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:01.551636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 513/1012] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:01 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:01.623179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc96c-dab6-4391-b706-c9c20cca5280 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:01.623521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc96c-dab6-4391-b706-c9c20cca5280 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:01.623738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc96c-dab6-4391-b706-c9c20cca5280 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:01.625485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 500/1013] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:01.630585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c5929-27be-497a-8b64-5e7c556d9f1f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:01.631433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c5929-27be-497a-8b64-5e7c556d9f1f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:01.631720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c5929-27be-497a-8b64-5e7c556d9f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:01.653249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a00c5929-27be-497a-8b64-5e7c556d9f1f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:01.654447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a00c5929-27be-497a-8b64-5e7c556d9f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:01.664500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:01.713648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc621fc6-6c1c-4bcd-abcb-b6769a2bccc1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:01.714289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc621fc6-6c1c-4bcd-abcb-b6769a2bccc1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:01.714575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc621fc6-6c1c-4bcd-abcb-b6769a2bccc1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:01.716065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 501/1014] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:49:01.721446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d91bb-14b0-4156-bd9e-9b33c5677818 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:01.721880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d91bb-14b0-4156-bd9e-9b33c5677818 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:01.722384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d91bb-14b0-4156-bd9e-9b33c5677818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:01.727562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 514/1015] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:01 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:01.743272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-950d91bb-14b0-4156-bd9e-9b33c5677818 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:01.744439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-950d91bb-14b0-4156-bd9e-9b33c5677818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:01.813934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 502/1016] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:01 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:49:01.824673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c5929-27be-497a-8b64-5e7c556d9f1f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:01.925685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c5929-27be-497a-8b64-5e7c556d9f1f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:01.960512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c77d6-6f51-474f-98db-4014a7249439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:01.961129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c77d6-6f51-474f-98db-4014a7249439 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:01.961406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c77d6-6f51-474f-98db-4014a7249439 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:01.961676 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c77d6-6f51-474f-98db-4014a7249439 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:01.962790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c77d6-6f51-474f-98db-4014a7249439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:01.964277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c77d6-6f51-474f-98db-4014a7249439 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:01.965984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 515/1017] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:01.971536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d91bb-14b0-4156-bd9e-9b33c5677818 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.018230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:02.023459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c77d6-6f51-474f-98db-4014a7249439 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.036866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:02.076359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d91bb-14b0-4156-bd9e-9b33c5677818 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.110741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1c894-5c7e-4d42-85fa-7fadf614f1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.111374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1c894-5c7e-4d42-85fa-7fadf614f1ba None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.111648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1c894-5c7e-4d42-85fa-7fadf614f1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.111915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1c894-5c7e-4d42-85fa-7fadf614f1ba None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.112563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1c894-5c7e-4d42-85fa-7fadf614f1ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.114046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1c894-5c7e-4d42-85fa-7fadf614f1ba None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.133011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c77d6-6f51-474f-98db-4014a7249439 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.141099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 503/1018] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:49:01 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:49:02.141912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1c894-5c7e-4d42-85fa-7fadf614f1ba None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.182380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.183338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.183757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.184206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.184934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.186572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:02.197587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:02.198936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:49:02.199976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:02.202641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 516/1019] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Sep 24 04:49:02 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:49:02.208978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.255080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:02.264903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1c894-5c7e-4d42-85fa-7fadf614f1ba None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.291313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:02.308659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.309479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.310069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.310346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.311568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.312420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:02.324572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:02.325629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:02.326491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 504/1020] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:49:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:02.329036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c45c1-2d65-4b50-bd1e-ca258733a5d5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.331485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.370967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.373617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.374380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.374916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.375737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:02.376046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.378334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.385281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 517/1021] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:02.391309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.444373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d553fe2-641a-4b92-a61a-dd8b58855acc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.480318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.480984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.481297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.481461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.482566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:02.482894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.484643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.492180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 505/1022] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:49:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:02.497872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9e2ba-80ed-4878-9dc0-15bae2e616d7 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.500012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.527146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:02.536294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.536893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.537802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.538306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.538997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] RBAC: Adding query filter params (type=image) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:02.539298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.540657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.542677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:02.550691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 518/1023] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:02.552749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.617609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913b4a-7702-49d3-8f3b-20ffe096290e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.659577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d836-6b05-49d0-bb20-dae5159d012e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.659806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.660443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.660652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.661008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.662047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:02.662047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.663948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.673933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 506/1024] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 24 04:49:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:02.674969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.699420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.700023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.700304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.700575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.701272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] RBAC: Adding query filter params (interface=public, service_id=b04e1bf4347c418fbb52ef677fb0c978, region_id=RegionOne) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:02.701578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.702964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.707951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 519/1025] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 24 04:49:02 2022] GET /identity/v3/endpoints?service_id=b04e1bf4347c418fbb52ef677fb0c978&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:02.715025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:02.771335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:02.783732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:02.784414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1314-86f5-4ab1-a9cf-aa0bd64bbf9c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.820525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6248f0-3362-4dc3-bf79-87128f0b96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.821331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6248f0-3362-4dc3-bf79-87128f0b96cc None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.821444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6248f0-3362-4dc3-bf79-87128f0b96cc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.821643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6248f0-3362-4dc3-bf79-87128f0b96cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.822298 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6248f0-3362-4dc3-bf79-87128f0b96cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.823669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6248f0-3362-4dc3-bf79-87128f0b96cc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.827550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c68b4-4e53-4731-8484-192d93e121fa None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:02.844982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 507/1026] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:49:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:49:02.874163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d09128-c437-4ac0-aae2-ef7992cee3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:02.875220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09128-c437-4ac0-aae2-ef7992cee3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:02.875675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09128-c437-4ac0-aae2-ef7992cee3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:02.876255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09128-c437-4ac0-aae2-ef7992cee3f5 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:02.877042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d09128-c437-4ac0-aae2-ef7992cee3f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:02.878770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d09128-c437-4ac0-aae2-ef7992cee3f5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:02.887378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 520/1027] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:49:02 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 04:49:04.380800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995516b2-77e9-411a-abe8-8c30310d7572 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:04.381351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995516b2-77e9-411a-abe8-8c30310d7572 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:04.381431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995516b2-77e9-411a-abe8-8c30310d7572 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:04.382888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 508/1028] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:04.387972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf57afd-1259-4e27-807f-a6bcddfd18f0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:04.388358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf57afd-1259-4e27-807f-a6bcddfd18f0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:04.388514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf57afd-1259-4e27-807f-a6bcddfd18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:04.406335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cdf57afd-1259-4e27-807f-a6bcddfd18f0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:04.407535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cdf57afd-1259-4e27-807f-a6bcddfd18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:04.475438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 521/1029] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:04.743909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995516b2-77e9-411a-abe8-8c30310d7572 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:04.846433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995516b2-77e9-411a-abe8-8c30310d7572 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:04.880074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481f3d-8e67-4d39-8a29-cedd48b1a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:04.880763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481f3d-8e67-4d39-8a29-cedd48b1a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:04.881035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481f3d-8e67-4d39-8a29-cedd48b1a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:04.881302 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481f3d-8e67-4d39-8a29-cedd48b1a9a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:04.882412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09481f3d-8e67-4d39-8a29-cedd48b1a9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:04.883860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09481f3d-8e67-4d39-8a29-cedd48b1a9a5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:04.885596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 509/1030] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:04.891229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf57afd-1259-4e27-807f-a6bcddfd18f0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:04.948133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:04.997617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf57afd-1259-4e27-807f-a6bcddfd18f0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:05.034485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03828146-fc95-4878-840b-9fcbdf430cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:05.035141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03828146-fc95-4878-840b-9fcbdf430cf8 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.035417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03828146-fc95-4878-840b-9fcbdf430cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.035683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03828146-fc95-4878-840b-9fcbdf430cf8 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.036362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03828146-fc95-4878-840b-9fcbdf430cf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:05.038584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03828146-fc95-4878-840b-9fcbdf430cf8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:05.063161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 522/1031] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:49:04 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:49:05.078580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b247070-9ea2-4098-a919-d51837491886 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.078950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b247070-9ea2-4098-a919-d51837491886 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.079157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b247070-9ea2-4098-a919-d51837491886 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.080571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 510/1032] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:05.087152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609e389-9883-4517-bf3d-64b031741010 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.087468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609e389-9883-4517-bf3d-64b031741010 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.087709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609e389-9883-4517-bf3d-64b031741010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.108022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a609e389-9883-4517-bf3d-64b031741010 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:05.109240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a609e389-9883-4517-bf3d-64b031741010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:05.138475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7a073-7996-4a9e-8e7f-d7a83abfa5ed None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.138770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7a073-7996-4a9e-8e7f-d7a83abfa5ed None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.139047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7a073-7996-4a9e-8e7f-d7a83abfa5ed None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.140398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 511/1033] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:49:05.146229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12bfbd-6f02-4293-bc41-dedf950260b4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.149735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12bfbd-6f02-4293-bc41-dedf950260b4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.149735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12bfbd-6f02-4293-bc41-dedf950260b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.166921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6f12bfbd-6f02-4293-bc41-dedf950260b4 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:05.168266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6f12bfbd-6f02-4293-bc41-dedf950260b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:05.178488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:05.198276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 523/1034] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:05.248352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 512/1035] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:49:05.469042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609e389-9883-4517-bf3d-64b031741010 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:05.511594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:05.524058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12bfbd-6f02-4293-bc41-dedf950260b4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:05.576920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609e389-9883-4517-bf3d-64b031741010 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:05.613086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:05.613713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.613986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.614254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.614872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:05.616295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:05.625377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:05.626575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:05.627659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 524/1036] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Sep 24 04:49:05 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:05.632817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12bfbd-6f02-4293-bc41-dedf950260b4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:05.634423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:05.673951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbae385-5367-4e0d-892d-7e741c02666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:05.674580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae385-5367-4e0d-892d-7e741c02666d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.674892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae385-5367-4e0d-892d-7e741c02666d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.675163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae385-5367-4e0d-892d-7e741c02666d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.687737 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbae385-5367-4e0d-892d-7e741c02666d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-edbae385-5367-4e0d-892d-7e741c02666d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:05.693036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:05.695069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:05.695901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 513/1037] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Sep 24 04:49:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:49:05.700576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbae385-5367-4e0d-892d-7e741c02666d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:05.703970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:05.747972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d071189-6e16-4d87-b81d-ef6959b597f8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:05.751908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:05.792676 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:05.793285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.793566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.793837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.794466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:05.795781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:05.796902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:05.802055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 525/1038] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:05.808172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:05.808430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbae385-5367-4e0d-892d-7e741c02666d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:05.843754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:05.844358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.844636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.844908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.845635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:05.845938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:05.847418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:05.856461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 514/1039] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Sep 24 04:49:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:05.862037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:05.920193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fe0e9-236e-433d-aa40-407ff52cb9b4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:05.926138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:05.957539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:05.958134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:05.958407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:05.958669 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:05.959442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] RBAC: Adding query filter params (type=image) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:05.959848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:05.961231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:05.970542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 526/1040] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:05.970686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f656fc3-638f-4f46-a3f6-f4c1a809ae03 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:05.971490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:06.004407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:06.005143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:06.006288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:06.006644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:06.006881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:06.019166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:06.020643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:49:06.036091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:06.037852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:49:06.039004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:49:06.039004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:06.039004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:06.039004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 515/1041] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:06.043520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:06.088176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeba82-0f92-402b-8535-ae90f2dcd754 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:06.121877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5470d4a-1315-4b3e-b17f-375295e3102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:06.122473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5470d4a-1315-4b3e-b17f-375295e3102d None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:06.122745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5470d4a-1315-4b3e-b17f-375295e3102d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:06.123042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5470d4a-1315-4b3e-b17f-375295e3102d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:06.123698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5470d4a-1315-4b3e-b17f-375295e3102d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:06.125303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5470d4a-1315-4b3e-b17f-375295e3102d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:06.146844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 527/1042] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:49:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:49:06.155032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676a3b-3a1f-456d-8a0f-bd43ed14c0a5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:06.174063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:06.202256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:06.202896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:06.203173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:06.203440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:06.204091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:06.204390 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:06.205782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:06.219442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 516/1043] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:06.226487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5470d4a-1315-4b3e-b17f-375295e3102d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:06.329826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:06.344750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5470d4a-1315-4b3e-b17f-375295e3102d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:06.380766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:06.381543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:06.381817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:06.382154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:06.390060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:06.391642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:49:06.403694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:06.404891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:49:06.405952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:06.406498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 528/1044] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:49:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:06.411545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:06.513333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9bd64-75d3-4093-9d87-6813b81ae191 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:06.547346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:06.547981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:06.548270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:06.548545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:06.549262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:06.549565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:06.550990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:06.569807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 517/1045] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:49:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:06.575354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:06.682333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5efa3d-399c-47cc-9a25-79b20039c846 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:06.715536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f281cc-5ce0-4d11-8c9a-8362941b1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:06.716139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f281cc-5ce0-4d11-8c9a-8362941b1ceb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:06.716416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f281cc-5ce0-4d11-8c9a-8362941b1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:06.716685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f281cc-5ce0-4d11-8c9a-8362941b1ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:06.735239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:06.785827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f281cc-5ce0-4d11-8c9a-8362941b1ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:06.787838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f281cc-5ce0-4d11-8c9a-8362941b1ceb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:06.890943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 529/1046] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:49:06.892567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:06.923769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:06.996351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefea5d-2bf3-4b45-833a-a72067a3ed9f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:07.030554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:07.031247 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:07.031523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:07.031790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:07.042154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:07.043672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:49:07.060539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:07.061571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:49:07.062476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:49:07.062476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:07.062476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:07.066796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 518/1047] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:07.067524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f281cc-5ce0-4d11-8c9a-8362941b1ceb None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:07.116385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:07.168470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f281cc-5ce0-4d11-8c9a-8362941b1ceb None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:07.202292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff72366-af3f-4ca3-985d-156e7e5af2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:07.202859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff72366-af3f-4ca3-985d-156e7e5af2ff None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:07.203135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff72366-af3f-4ca3-985d-156e7e5af2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:07.203395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff72366-af3f-4ca3-985d-156e7e5af2ff None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:07.204045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff72366-af3f-4ca3-985d-156e7e5af2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:07.204339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff72366-af3f-4ca3-985d-156e7e5af2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:07.205745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff72366-af3f-4ca3-985d-156e7e5af2ff None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:07.227623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 530/1048] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:07.229183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:07.318659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:07.324694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2448-c2c5-4f74-9b65-f21a9b1e01f7 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:07.325064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2448-c2c5-4f74-9b65-f21a9b1e01f7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:07.325404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be2448-c2c5-4f74-9b65-f21a9b1e01f7 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:07.326814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 531/1049] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:49:07.331798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc499e0-bd8a-4333-b56d-57f9d7a6410b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:07.332085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc499e0-bd8a-4333-b56d-57f9d7a6410b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:07.332360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc499e0-bd8a-4333-b56d-57f9d7a6410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:07.343579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a442b3d-7e31-43b0-a182-223f9021861a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:07.350963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7bc499e0-bd8a-4333-b56d-57f9d7a6410b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:07.352150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7bc499e0-bd8a-4333-b56d-57f9d7a6410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:07.382968 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:07.384175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:07.384452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:07.384719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:07.391332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:07.392801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:49:07.405091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:07.406032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:07.407810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 519/1050] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:49:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:49:07.411977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:07.426193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 532/1051] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:49:07.514949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf74fb1-cddf-43d5-8154-de9e25e7f472 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:07.548719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:07.549333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:07.549576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:07.549842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:07.550521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:07.550846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:07.552246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:07.569807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 520/1052] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:49:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:07.571570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc499e0-bd8a-4333-b56d-57f9d7a6410b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:07.612094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:07.681259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc499e0-bd8a-4333-b56d-57f9d7a6410b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:07.694555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:07.697599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:07.717551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:07.718151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:07.718430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:07.718708 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:07.719458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] RBAC: Adding query filter params (role.id=1b00469c884a4dbeb71c91c3bcc4a347, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=3b877cb99245408b8ca37c9e85eb023e) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:07.719780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:07.721197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:07.734793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 533/1053] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:07 2022] GET /identity/v3/role_assignments?user.id=3b877cb99245408b8ca37c9e85eb023e&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=1b00469c884a4dbeb71c91c3bcc4a347 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:07.815715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a976a51-c577-4916-9ca6-568686514568 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:07.852871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f57815-4cdc-465e-8c9c-fc41a83b9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:07.853516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f57815-4cdc-465e-8c9c-fc41a83b9e99 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:07.853790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f57815-4cdc-465e-8c9c-fc41a83b9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:07.854059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f57815-4cdc-465e-8c9c-fc41a83b9e99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:07.866814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f57815-4cdc-465e-8c9c-fc41a83b9e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-03f57815-4cdc-465e-8c9c-fc41a83b9e99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:07.871909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:07.872899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:07.875667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 521/1054] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:49:07.879700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:07.987273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee211ae-18d5-4a7d-8405-e22635de8a9f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:07.988812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:08.024264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:08.024876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:08.025155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:08.025427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:08.026087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:08.026391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:08.027787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:08.041974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 534/1055] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:08.043574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f57815-4cdc-465e-8c9c-fc41a83b9e99 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:08.108514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:08.148539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f57815-4cdc-465e-8c9c-fc41a83b9e99 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:08.183218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e77f7e-e383-44f8-94cd-5f36274dedd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:08.183839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77f7e-e383-44f8-94cd-5f36274dedd7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:08.184116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77f7e-e383-44f8-94cd-5f36274dedd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:08.184446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77f7e-e383-44f8-94cd-5f36274dedd7 None admin] PATH_INFO: `/v3/users/266b8d00db464d849eabd4d089c4e57d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:08.198804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e77f7e-e383-44f8-94cd-5f36274dedd7 None admin] RBAC: Authorizing `identity:get_user(user_id=266b8d00db464d849eabd4d089c4e57d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:08.200241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e77f7e-e383-44f8-94cd-5f36274dedd7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:08.202055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 522/1056] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:08 2022] GET /identity/v3/users/266b8d00db464d849eabd4d089c4e57d => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:08.207845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:08.318553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277beaf-1f95-4a80-a62a-12647a024545 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:08.353824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70698e5-78cb-48db-abf5-719b3c80857d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:08.354106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70698e5-78cb-48db-abf5-719b3c80857d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:08.354375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70698e5-78cb-48db-abf5-719b3c80857d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:08.355924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 523/1057] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:49:08.357615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2158b5-12f5-4d96-b6ff-7fc2b688342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:08.358484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2158b5-12f5-4d96-b6ff-7fc2b688342a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:08.359134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2158b5-12f5-4d96-b6ff-7fc2b688342a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:08.359767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2158b5-12f5-4d96-b6ff-7fc2b688342a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:08.361161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd643e-e41a-49ac-bf71-537122876ae1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:08.361436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd643e-e41a-49ac-bf71-537122876ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:08.361699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd643e-e41a-49ac-bf71-537122876ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:08.380726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-26fd643e-e41a-49ac-bf71-537122876ae1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:08.382394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-26fd643e-e41a-49ac-bf71-537122876ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:08.394690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:08.435801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2158b5-12f5-4d96-b6ff-7fc2b688342a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:08.437648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2158b5-12f5-4d96-b6ff-7fc2b688342a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:08.461451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 524/1058] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:08.543924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 535/1059] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 04:49:08.545761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd643e-e41a-49ac-bf71-537122876ae1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:08.598647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:08.660216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd643e-e41a-49ac-bf71-537122876ae1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:08.694900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825575c-b12c-4d64-9292-743d8d7580b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:08.695527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825575c-b12c-4d64-9292-743d8d7580b4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:08.695800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825575c-b12c-4d64-9292-743d8d7580b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:08.696067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825575c-b12c-4d64-9292-743d8d7580b4 None admin] PATH_INFO: `/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:08.697168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825575c-b12c-4d64-9292-743d8d7580b4 None admin] RBAC: Authorizing `identity:get_project(project_id=8c93d115af0c4a86a1b8b52ac89a7193)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:08.698575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825575c-b12c-4d64-9292-743d8d7580b4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:08.702910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 525/1060] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:08 2022] GET /identity/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:08.706524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2158b5-12f5-4d96-b6ff-7fc2b688342a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:08.734667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825575c-b12c-4d64-9292-743d8d7580b4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:08.773629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:08.815921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2158b5-12f5-4d96-b6ff-7fc2b688342a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:08.841189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825575c-b12c-4d64-9292-743d8d7580b4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:08.854844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:08.855738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:08.855738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:08.856011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:08.856756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=8c93d115af0c4a86a1b8b52ac89a7193, user.id=266b8d00db464d849eabd4d089c4e57d) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:08.857064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:08.858487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:08.859904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:08.874800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 536/1061] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:08 2022] GET /identity/v3/role_assignments?user.id=266b8d00db464d849eabd4d089c4e57d&scope.project.id=8c93d115af0c4a86a1b8b52ac89a7193&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:08.890459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e20dba-7017-4e2f-aeea-c862dc490d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:08.891235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20dba-7017-4e2f-aeea-c862dc490d99 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:08.891579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20dba-7017-4e2f-aeea-c862dc490d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:08.891938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20dba-7017-4e2f-aeea-c862dc490d99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:08.967272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e20dba-7017-4e2f-aeea-c862dc490d99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:08.968628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e20dba-7017-4e2f-aeea-c862dc490d99 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:09.078329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 526/1062] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 04:49:09.085003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:09.185303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333e732-cb2a-4032-aac0-3300d96c6bda None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:09.212102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:09.221510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf939ce6-e68f-4cb4-af17-b37294643c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:09.222074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf939ce6-e68f-4cb4-af17-b37294643c87 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:09.222352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf939ce6-e68f-4cb4-af17-b37294643c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:09.222620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf939ce6-e68f-4cb4-af17-b37294643c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:09.233992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf939ce6-e68f-4cb4-af17-b37294643c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:09.235468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf939ce6-e68f-4cb4-af17-b37294643c87 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-cf939ce6-e68f-4cb4-af17-b37294643c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:49:09.250724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:09.251765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:49:09.258532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:49:09.258532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:09.258532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:09.258532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 537/1063] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:09.260278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e20dba-7017-4e2f-aeea-c862dc490d99 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:09.278790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:09.365429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e20dba-7017-4e2f-aeea-c862dc490d99 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:09.400416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8562d3-64d7-40db-bb33-d1a536ec0fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:09.401015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8562d3-64d7-40db-bb33-d1a536ec0fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:09.401341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8562d3-64d7-40db-bb33-d1a536ec0fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:09.401616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8562d3-64d7-40db-bb33-d1a536ec0fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:09.402354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8562d3-64d7-40db-bb33-d1a536ec0fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:09.402661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8562d3-64d7-40db-bb33-d1a536ec0fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:09.404073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8562d3-64d7-40db-bb33-d1a536ec0fd6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:09.422784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 527/1064] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:09.889786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43685c89-38ef-4cd1-ba26-3fd28c2a4c13 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:09.890354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43685c89-38ef-4cd1-ba26-3fd28c2a4c13 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:09.890354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43685c89-38ef-4cd1-ba26-3fd28c2a4c13 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:09.893902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 538/1065] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:09.899611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97d4f-6b5f-4521-b081-9c3740772df1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:09.900072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97d4f-6b5f-4521-b081-9c3740772df1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:09.900183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97d4f-6b5f-4521-b081-9c3740772df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:09.918730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eef97d4f-6b5f-4521-b081-9c3740772df1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:09.919882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eef97d4f-6b5f-4521-b081-9c3740772df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:09.984268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 528/1066] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:10.254325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43685c89-38ef-4cd1-ba26-3fd28c2a4c13 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:10.353203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43685c89-38ef-4cd1-ba26-3fd28c2a4c13 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:10.386285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45170a47-345b-439b-8b3f-ae882435248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:10.386940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170a47-345b-439b-8b3f-ae882435248e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:10.387213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170a47-345b-439b-8b3f-ae882435248e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:10.387486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170a47-345b-439b-8b3f-ae882435248e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:10.397962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45170a47-345b-439b-8b3f-ae882435248e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-45170a47-345b-439b-8b3f-ae882435248e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:10.402713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:10.404147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:10.405124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 539/1067] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Sep 24 04:49:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:10.409983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef97d4f-6b5f-4521-b081-9c3740772df1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:10.420068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:10.506722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef97d4f-6b5f-4521-b081-9c3740772df1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:10.539792 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:10.540392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:10.540669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:10.540939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:10.541596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:10.541901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:10.543288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:10.551324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 529/1068] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Sep 24 04:49:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:10.556978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45170a47-345b-439b-8b3f-ae882435248e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:10.600494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:10.657117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45170a47-345b-439b-8b3f-ae882435248e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:10.691821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:10.692433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:10.692707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:10.692972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:10.702892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:10.704315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:49:10.719555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:10.720517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:49:10.721446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:49:10.721446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:10.721446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:10.721446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 540/1069] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:10.726986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:10.793517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:10.823403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2f37-d4cf-4fdf-b057-bb9a623cb69d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:10.855790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2394-0f00-456b-b3ea-1f654459b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:10.856383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2394-0f00-456b-b3ea-1f654459b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:10.856653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2394-0f00-456b-b3ea-1f654459b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:10.856919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2394-0f00-456b-b3ea-1f654459b8a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:10.857542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d2394-0f00-456b-b3ea-1f654459b8a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:10.857840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d2394-0f00-456b-b3ea-1f654459b8a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:10.859222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d2394-0f00-456b-b3ea-1f654459b8a7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:10.870986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 530/1070] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:10.877103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:10.969451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:10.978661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba7e9-cdb7-42d4-a3e2-ba59a28524fd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.008575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22a4bc-498a-43bf-9f68-4236681a2b73 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.009095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22a4bc-498a-43bf-9f68-4236681a2b73 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.009095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22a4bc-498a-43bf-9f68-4236681a2b73 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.010424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 531/1071] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:49:11.015043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33276-6104-408c-93c9-d4e297d6b908 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.015329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33276-6104-408c-93c9-d4e297d6b908 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.015589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33276-6104-408c-93c9-d4e297d6b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.016106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.016724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.016995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.017257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.025117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.026540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.034364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c2b33276-6104-408c-93c9-d4e297d6b908 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:11.035579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c2b33276-6104-408c-93c9-d4e297d6b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:49:11.039164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:11.040204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:11.041167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 541/1072] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:49:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:11.046151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.102372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 532/1073] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:49:11.144095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c145-f50d-4bfd-ab26-a3286cb6994a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.176604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.177189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.178129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.178567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.179431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:11.179736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.181147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.197947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 542/1074] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:11.203663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b33276-6104-408c-93c9-d4e297d6b908 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.261143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:11.301372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b33276-6104-408c-93c9-d4e297d6b908 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.335229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.335842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.336122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.336389 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.345931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.347394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:49:11.362221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:11.368001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:49:11.368955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:49:11.368955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:11.368955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:11.368955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 533/1075] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:11.369216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.370312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.381594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:11.468659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d5f86-5e9f-4b0f-8b38-d90f0c08c247 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.470909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe66ec3-207c-45e6-9cbf-3c277a032208 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.481653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:11.502232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0316e-3f62-42b3-a0b0-d60141a1717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.502892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0316e-3f62-42b3-a0b0-d60141a1717f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.503170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0316e-3f62-42b3-a0b0-d60141a1717f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.503437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0316e-3f62-42b3-a0b0-d60141a1717f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.505514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.506395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.506719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.507020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.507675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:11.507973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.509327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.513821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0316e-3f62-42b3-a0b0-d60141a1717f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fde0316e-3f62-42b3-a0b0-d60141a1717f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:11.518567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:11.519581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:11.520476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 534/1076] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:49:11.522084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 543/1077] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:11.526189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0316e-3f62-42b3-a0b0-d60141a1717f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.526375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.595882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:11.626274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0316e-3f62-42b3-a0b0-d60141a1717f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.627566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0571c-6e06-4d96-b0a2-dd1fbcdb9687 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.660102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.661178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.661261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.661350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.661350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.661497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.661724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.662564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.662674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:11.662999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.664341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.669362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.670813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.672822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 535/1078] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:11.678576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:49:11.684401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:11.685511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:11.686637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 544/1079] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:49:11.691084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.712953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:11.780372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1c870-7514-4c29-9027-c54aa47cf7bb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.789839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1077-c44d-46f3-9482-d227238245b1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.812930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e1b3-6e2d-4fad-b6bf-b3f981393677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.813601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e1b3-6e2d-4fad-b6bf-b3f981393677 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.813886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e1b3-6e2d-4fad-b6bf-b3f981393677 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.814157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e1b3-6e2d-4fad-b6bf-b3f981393677 None admin] PATH_INFO: `/v3/users/266b8d00db464d849eabd4d089c4e57d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.815292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5e1b3-6e2d-4fad-b6bf-b3f981393677 None admin] RBAC: Authorizing `identity:get_user(user_id=266b8d00db464d849eabd4d089c4e57d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.816707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5e1b3-6e2d-4fad-b6bf-b3f981393677 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.816854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:11.818800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 536/1080] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/users/266b8d00db464d849eabd4d089c4e57d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:11.823610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.824213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.824474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e1b3-6e2d-4fad-b6bf-b3f981393677 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.824586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.824810 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.825447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:11.825752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.827225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.839768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 545/1081] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:11.845583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.927936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e1b3-6e2d-4fad-b6bf-b3f981393677 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.929337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:11.941288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33ccc-0195-4743-8b1d-3ea523a6904a None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:11.962552 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e3c1-b4a2-4360-9a7e-8d156e9b00cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.963193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e3c1-b4a2-4360-9a7e-8d156e9b00cb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.963463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e3c1-b4a2-4360-9a7e-8d156e9b00cb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.963728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e3c1-b4a2-4360-9a7e-8d156e9b00cb None admin] PATH_INFO: `/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.964812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e3c1-b4a2-4360-9a7e-8d156e9b00cb None admin] RBAC: Authorizing `identity:get_project(project_id=8c93d115af0c4a86a1b8b52ac89a7193)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.966207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e3c1-b4a2-4360-9a7e-8d156e9b00cb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.967836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 537/1082] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:11 2022] GET /identity/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:11.973564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e3c1-b4a2-4360-9a7e-8d156e9b00cb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:11.975498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f88c91-0357-46d1-bf14-7830524fbe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:11.976148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88c91-0357-46d1-bf14-7830524fbe40 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:11.976421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88c91-0357-46d1-bf14-7830524fbe40 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:11.976694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88c91-0357-46d1-bf14-7830524fbe40 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/3b877cb99245408b8ca37c9e85eb023e/roles/1b00469c884a4dbeb71c91c3bcc4a347` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:11.978899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f88c91-0357-46d1-bf14-7830524fbe40 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=3b877cb99245408b8ca37c9e85eb023e, role_id=1b00469c884a4dbeb71c91c3bcc4a347)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:11.980314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f88c91-0357-46d1-bf14-7830524fbe40 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:11.993770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 546/1083] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:49:11 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/3b877cb99245408b8ca37c9e85eb023e/roles/1b00469c884a4dbeb71c91c3bcc4a347 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 04:49:12.079001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e3c1-b4a2-4360-9a7e-8d156e9b00cb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:12.115566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df54f10-cf10-495d-bf80-ea253438cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:12.116247 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54f10-cf10-495d-bf80-ea253438cb29 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:12.116514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54f10-cf10-495d-bf80-ea253438cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:12.116784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54f10-cf10-495d-bf80-ea253438cb29 None admin] PATH_INFO: `/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193/users/266b8d00db464d849eabd4d089c4e57d/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:12.118822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df54f10-cf10-495d-bf80-ea253438cb29 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c93d115af0c4a86a1b8b52ac89a7193, user_id=266b8d00db464d849eabd4d089c4e57d, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:12.120267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df54f10-cf10-495d-bf80-ea253438cb29 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:12.134472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 538/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:49:11 2022] PUT /identity/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193/users/266b8d00db464d849eabd4d089c4e57d/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 04:49:14.141008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1b7f7-3650-41c2-bbad-dbc803a118b4 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.141621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1b7f7-3650-41c2-bbad-dbc803a118b4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.141621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1b7f7-3650-41c2-bbad-dbc803a118b4 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.142945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 547/1085] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:14.149071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0ce6-5c70-4301-9341-4ada536c3faf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.149623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0ce6-5c70-4301-9341-4ada536c3faf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.149623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0ce6-5c70-4301-9341-4ada536c3faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.169241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4e4c0ce6-5c70-4301-9341-4ada536c3faf None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:14.170462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e4c0ce6-5c70-4301-9341-4ada536c3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:14.195079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:14.237787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 539/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:14.262537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ef3f1-2e51-4cc9-a6fb-820b7ecc541b None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.262850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ef3f1-2e51-4cc9-a6fb-820b7ecc541b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.263125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ef3f1-2e51-4cc9-a6fb-820b7ecc541b None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.264438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 548/1087] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:14.269633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c68a-d0c3-4fdc-8238-ad2e44a42c0b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.269912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c68a-d0c3-4fdc-8238-ad2e44a42c0b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.270185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256c68a-d0c3-4fdc-8238-ad2e44a42c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.288457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b256c68a-d0c3-4fdc-8238-ad2e44a42c0b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:14.289613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b256c68a-d0c3-4fdc-8238-ad2e44a42c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:14.353986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 540/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:14.508979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ef3f1-2e51-4cc9-a6fb-820b7ecc541b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:14.559291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:14.609835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ef3f1-2e51-4cc9-a6fb-820b7ecc541b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:14.632452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c68a-d0c3-4fdc-8238-ad2e44a42c0b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:14.643724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3eed-2b46-4681-a93d-810e169c428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:14.644358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3eed-2b46-4681-a93d-810e169c428c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.644732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3eed-2b46-4681-a93d-810e169c428c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.644978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3eed-2b46-4681-a93d-810e169c428c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.656767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc3eed-2b46-4681-a93d-810e169c428c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-4edc3eed-2b46-4681-a93d-810e169c428c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:14.661572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:14.663280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:14.664364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 549/1089] 10.222.0.26 () {56 vars in 1120 bytes} [Sat Sep 24 04:49:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:14.669410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3eed-2b46-4681-a93d-810e169c428c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:14.725974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:14.735597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256c68a-d0c3-4fdc-8238-ad2e44a42c0b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:14.768482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3eed-2b46-4681-a93d-810e169c428c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:14.769515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a075c57-b272-4da2-8477-213fa527b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:14.770132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a075c57-b272-4da2-8477-213fa527b762 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.770403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a075c57-b272-4da2-8477-213fa527b762 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.770672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a075c57-b272-4da2-8477-213fa527b762 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.778935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:14.780555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a075c57-b272-4da2-8477-213fa527b762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6a075c57-b272-4da2-8477-213fa527b762 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:14.785328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:14.786304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:14.788377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 541/1090] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:49:14.792782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a075c57-b272-4da2-8477-213fa527b762 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:14.804179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:14.804776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.805056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.805327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.805983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:14.806286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:14.807681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:14.815481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 550/1091] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Sep 24 04:49:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:14.821475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:14.890462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a075c57-b272-4da2-8477-213fa527b762 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:14.918789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7e9b-aa37-48c7-8fb5-cff36babcff5 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:14.924874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:14.925473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.925746 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.926011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.926659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:14.926992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:14.929046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:14.937058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 542/1092] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:14.942649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:14.951599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:14.952237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:14.952517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:14.952789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:14.961142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:14.964132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:14.965577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:49:14.980243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:14.981298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:49:14.982383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:49:14.982383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:14.982383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:14.982383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 551/1093] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:14.986923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:15.012341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:15.047466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7525-fc22-44ec-a889-0956608f8ed7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.080778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7297f1a-9357-452b-989e-84d8486abd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.081394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297f1a-9357-452b-989e-84d8486abd0b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.081666 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297f1a-9357-452b-989e-84d8486abd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.081937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297f1a-9357-452b-989e-84d8486abd0b None admin] PATH_INFO: `/v3/users/266b8d00db464d849eabd4d089c4e57d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.083063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7297f1a-9357-452b-989e-84d8486abd0b None admin] RBAC: Authorizing `identity:get_user(user_id=266b8d00db464d849eabd4d089c4e57d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.085189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7297f1a-9357-452b-989e-84d8486abd0b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.086140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a537ac-edc8-407b-8d06-5975ed0bcdd1 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.087071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 543/1094] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:14 2022] GET /identity/v3/users/266b8d00db464d849eabd4d089c4e57d => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:15.092556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7297f1a-9357-452b-989e-84d8486abd0b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:15.122380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.123013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.123289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.123560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.124449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:15.124749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.126100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.138177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 552/1095] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:15.143738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:15.172908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:15.192200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7297f1a-9357-452b-989e-84d8486abd0b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.227315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d533bfb-752b-42f2-a42d-4d3a8f2ebf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.227844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:15.228088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d533bfb-752b-42f2-a42d-4d3a8f2ebf20 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.228433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d533bfb-752b-42f2-a42d-4d3a8f2ebf20 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.228724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d533bfb-752b-42f2-a42d-4d3a8f2ebf20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.244533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594831-e237-40f3-8584-ed605704e826 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.277944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.278559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.278875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.279149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.285970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.288127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.296985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d533bfb-752b-42f2-a42d-4d3a8f2ebf20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.298463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d533bfb-752b-42f2-a42d-4d3a8f2ebf20 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:49:15.300084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:15.301184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:15.302356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 553/1096] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 24 04:49:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:49:15.307127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:15.379970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:15.400881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 544/1097] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 04:49:15.405473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1338fa-8cbb-46e2-8408-a352f647c9e4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.406520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d533bfb-752b-42f2-a42d-4d3a8f2ebf20 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:15.438585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.439212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.439488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.439756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.440474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:15.440777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.442193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.459488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 554/1098] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 24 04:49:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:15.465206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:15.467733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:15.503825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d533bfb-752b-42f2-a42d-4d3a8f2ebf20 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.536384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd72bc-0345-4569-8b6b-ba53ac719dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.537505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd72bc-0345-4569-8b6b-ba53ac719dcf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.537777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd72bc-0345-4569-8b6b-ba53ac719dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.538048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd72bc-0345-4569-8b6b-ba53ac719dcf None admin] PATH_INFO: `/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.539187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd72bc-0345-4569-8b6b-ba53ac719dcf None admin] RBAC: Authorizing `identity:get_project(project_id=8c93d115af0c4a86a1b8b52ac89a7193)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.540607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd72bc-0345-4569-8b6b-ba53ac719dcf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.542224 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 545/1099] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:15 2022] GET /identity/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:15.548264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd72bc-0345-4569-8b6b-ba53ac719dcf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:15.569805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586690c-a839-4f76-b8c2-1fb2f6b6bac8 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.597333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:15.603685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c505-16c9-4830-802a-2d76114cf0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.604272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c505-16c9-4830-802a-2d76114cf0ae None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.604546 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c505-16c9-4830-802a-2d76114cf0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.604811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c505-16c9-4830-802a-2d76114cf0ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.648949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd72bc-0345-4569-8b6b-ba53ac719dcf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.673056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c505-16c9-4830-802a-2d76114cf0ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.674503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c505-16c9-4830-802a-2d76114cf0ae None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.676386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:15.683236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.683840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.684120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.684390 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.685105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=8c93d115af0c4a86a1b8b52ac89a7193, user.id=266b8d00db464d849eabd4d089c4e57d) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:15.685413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.686849 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.692682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 546/1100] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:15 2022] GET /identity/v3/role_assignments?user.id=266b8d00db464d849eabd4d089c4e57d&scope.project.id=8c93d115af0c4a86a1b8b52ac89a7193&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:15.784296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 555/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 04:49:15.790321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:15.896237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594341e4-5999-4151-8e77-64cbea822fac None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:15.909153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:15.930477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:15.931127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:15.931398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:15.931660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:15.942671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:15.945180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:49:15.958932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:15.960063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:49:15.961023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:49:15.961023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:49:15.961023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:15.961023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 547/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:15.965895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c505-16c9-4830-802a-2d76114cf0ae None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:16.062935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c505-16c9-4830-802a-2d76114cf0ae None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:16.064432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:16.097759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:16.098354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:16.098628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:16.098935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:16.099820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:16.100113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:16.101471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:16.112434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 556/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:16.118808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:16.216447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15de76-dab5-454b-950d-24e2852faf8f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:16.248859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:16.249738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:16.250010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:16.250276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:16.257473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:16.258930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:49:16.269902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:16.270797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:16.271798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 548/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:49:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:16.277205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:16.375100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae44422-d6fe-4806-b4b9-23e7f294d864 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:16.407058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4bd6-67c8-41d5-86f8-a4faad5f5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:16.407657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4bd6-67c8-41d5-86f8-a4faad5f5d25 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:16.407933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4bd6-67c8-41d5-86f8-a4faad5f5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:16.408203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4bd6-67c8-41d5-86f8-a4faad5f5d25 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:16.408884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef4bd6-67c8-41d5-86f8-a4faad5f5d25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:16.409187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef4bd6-67c8-41d5-86f8-a4faad5f5d25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:16.410604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef4bd6-67c8-41d5-86f8-a4faad5f5d25 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:16.423552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 557/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:49:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:16.430682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:16.459286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:16.535926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300d256-d908-4694-a492-a02fb8a0f029 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:16.573126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc5b1d-5f4a-47e6-a3e4-360ce27520e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:16.573830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5b1d-5f4a-47e6-a3e4-360ce27520e2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:16.574178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5b1d-5f4a-47e6-a3e4-360ce27520e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:16.574447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5b1d-5f4a-47e6-a3e4-360ce27520e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:16.575212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5b1d-5f4a-47e6-a3e4-360ce27520e2 None admin] RBAC: Adding query filter params (role.id=1b00469c884a4dbeb71c91c3bcc4a347, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=3b877cb99245408b8ca37c9e85eb023e) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:16.575515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5b1d-5f4a-47e6-a3e4-360ce27520e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:16.576932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5b1d-5f4a-47e6-a3e4-360ce27520e2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:16.584669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 549/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:16 2022] GET /identity/v3/role_assignments?user.id=3b877cb99245408b8ca37c9e85eb023e&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=1b00469c884a4dbeb71c91c3bcc4a347 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:17.882591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e702e7-885a-41b2-882f-f279aeb9329e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:17.883154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e702e7-885a-41b2-882f-f279aeb9329e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:17.883154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e702e7-885a-41b2-882f-f279aeb9329e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:17.884483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 558/1107] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:17.889767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04f5a8-bf16-4735-9896-c70a0f3d94ca None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:17.890194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04f5a8-bf16-4735-9896-c70a0f3d94ca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:17.890286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04f5a8-bf16-4735-9896-c70a0f3d94ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:17.908063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ff04f5a8-bf16-4735-9896-c70a0f3d94ca None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:17.909231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff04f5a8-bf16-4735-9896-c70a0f3d94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:17.972970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 550/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:18.248528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e702e7-885a-41b2-882f-f279aeb9329e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:18.272668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:18.347323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e702e7-885a-41b2-882f-f279aeb9329e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:18.380166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ddb1f-0b53-4396-8df1-bbff422bc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:18.380796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ddb1f-0b53-4396-8df1-bbff422bc182 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:18.381149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ddb1f-0b53-4396-8df1-bbff422bc182 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:18.381421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ddb1f-0b53-4396-8df1-bbff422bc182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:18.382516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ddb1f-0b53-4396-8df1-bbff422bc182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:18.383972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ddb1f-0b53-4396-8df1-bbff422bc182 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:18.385515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 559/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:18.391211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04f5a8-bf16-4735-9896-c70a0f3d94ca None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:18.409846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:18.487874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04f5a8-bf16-4735-9896-c70a0f3d94ca None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:18.521302 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b3fda-77ee-400c-9e19-359a583394a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:18.522073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b3fda-77ee-400c-9e19-359a583394a6 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:18.522345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b3fda-77ee-400c-9e19-359a583394a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:18.522612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b3fda-77ee-400c-9e19-359a583394a6 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:18.523282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b3fda-77ee-400c-9e19-359a583394a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:18.524675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b3fda-77ee-400c-9e19-359a583394a6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:18.545624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 551/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:49:18 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:49:20.714085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77b5b6-70aa-4bc4-aa99-32dc4b608a10 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:20.714592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77b5b6-70aa-4bc4-aa99-32dc4b608a10 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:20.714592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77b5b6-70aa-4bc4-aa99-32dc4b608a10 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:20.715963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 560/1111] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:20.721326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980c7a-6369-44ad-affd-0bf901328538 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:20.721735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980c7a-6369-44ad-affd-0bf901328538 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:20.721843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980c7a-6369-44ad-affd-0bf901328538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:20.740188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-29980c7a-6369-44ad-affd-0bf901328538 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:20.741358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-29980c7a-6369-44ad-affd-0bf901328538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:20.805073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 552/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:21.072246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77b5b6-70aa-4bc4-aa99-32dc4b608a10 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:21.160826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:21.171427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77b5b6-70aa-4bc4-aa99-32dc4b608a10 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:21.204513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714e41-3f92-45d2-ae99-c02c5e13465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:21.205129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714e41-3f92-45d2-ae99-c02c5e13465c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:21.205406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714e41-3f92-45d2-ae99-c02c5e13465c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:21.205677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714e41-3f92-45d2-ae99-c02c5e13465c None admin] PATH_INFO: `/v3/roles/043adf092a6b422e961a0edc97df0a66` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:21.207105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4714e41-3f92-45d2-ae99-c02c5e13465c None admin] RBAC: Authorizing `identity:get_role(role_id=043adf092a6b422e961a0edc97df0a66)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:21.208485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4714e41-3f92-45d2-ae99-c02c5e13465c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:21.209983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 561/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:21 2022] GET /identity/v3/roles/043adf092a6b422e961a0edc97df0a66 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:21.215709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980c7a-6369-44ad-affd-0bf901328538 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:21.218694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:21.320318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980c7a-6369-44ad-affd-0bf901328538 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:21.352576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09576bd4-5c04-4cbd-8b99-2feaa51ab460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:21.353125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09576bd4-5c04-4cbd-8b99-2feaa51ab460 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:21.353398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09576bd4-5c04-4cbd-8b99-2feaa51ab460 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:21.353670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09576bd4-5c04-4cbd-8b99-2feaa51ab460 None admin] PATH_INFO: `/v3/users/c5057e673a804f43a234ff1d66b5ee97` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:21.366646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09576bd4-5c04-4cbd-8b99-2feaa51ab460 None admin] RBAC: Authorizing `identity:get_user(user_id=c5057e673a804f43a234ff1d66b5ee97)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:21.368085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09576bd4-5c04-4cbd-8b99-2feaa51ab460 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:21.369637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 553/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:21 2022] GET /identity/v3/users/c5057e673a804f43a234ff1d66b5ee97 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:21.375765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714e41-3f92-45d2-ae99-c02c5e13465c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:21.471952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714e41-3f92-45d2-ae99-c02c5e13465c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:21.504732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bba1a-1b59-4057-a9c5-ad39f3ed9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:21.505326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bba1a-1b59-4057-a9c5-ad39f3ed9422 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:21.506107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bba1a-1b59-4057-a9c5-ad39f3ed9422 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:21.506518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bba1a-1b59-4057-a9c5-ad39f3ed9422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:21.532720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:21.571723 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bba1a-1b59-4057-a9c5-ad39f3ed9422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:21.573160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bba1a-1b59-4057-a9c5-ad39f3ed9422 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:21.668347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 562/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:49:21.674383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09576bd4-5c04-4cbd-8b99-2feaa51ab460 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:21.733428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:21.770829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09576bd4-5c04-4cbd-8b99-2feaa51ab460 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:21.803146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bde34-0752-4be8-9230-8b180c7f8318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:21.803758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bde34-0752-4be8-9230-8b180c7f8318 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:21.804035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bde34-0752-4be8-9230-8b180c7f8318 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:21.804306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bde34-0752-4be8-9230-8b180c7f8318 None admin] PATH_INFO: `/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:21.805404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bde34-0752-4be8-9230-8b180c7f8318 None admin] RBAC: Authorizing `identity:get_project(project_id=8c93d115af0c4a86a1b8b52ac89a7193)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:21.806842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bde34-0752-4be8-9230-8b180c7f8318 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:21.808433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 554/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:21 2022] GET /identity/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:21.814655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bba1a-1b59-4057-a9c5-ad39f3ed9422 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:21.871887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:21.912584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bba1a-1b59-4057-a9c5-ad39f3ed9422 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:21.945652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b8b67-f235-40aa-a4c4-37248c9a1ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:21.946234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8b67-f235-40aa-a4c4-37248c9a1ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:21.946510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8b67-f235-40aa-a4c4-37248c9a1ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:21.946794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8b67-f235-40aa-a4c4-37248c9a1ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:21.947507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b8b67-f235-40aa-a4c4-37248c9a1ad3 None admin] RBAC: Adding query filter params (role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=8c93d115af0c4a86a1b8b52ac89a7193, user.id=c5057e673a804f43a234ff1d66b5ee97) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:21.947891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b8b67-f235-40aa-a4c4-37248c9a1ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:21.949327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b8b67-f235-40aa-a4c4-37248c9a1ad3 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:21.954498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 563/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:21 2022] GET /identity/v3/role_assignments?user.id=c5057e673a804f43a234ff1d66b5ee97&scope.project.id=8c93d115af0c4a86a1b8b52ac89a7193&role.id=043adf092a6b422e961a0edc97df0a66 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:24.062517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a4bb-9045-4d57-af6b-9f5d7cc48747 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:24.063122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a4bb-9045-4d57-af6b-9f5d7cc48747 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:24.063122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a4bb-9045-4d57-af6b-9f5d7cc48747 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:24.064405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 555/1118] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:24.070152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1951b-dfee-408e-bfa0-b8e4ebf48e1d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:24.070567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1951b-dfee-408e-bfa0-b8e4ebf48e1d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:24.070688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1951b-dfee-408e-bfa0-b8e4ebf48e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:24.089100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-30f1951b-dfee-408e-bfa0-b8e4ebf48e1d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:24.090284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-30f1951b-dfee-408e-bfa0-b8e4ebf48e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:24.154248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 564/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:24.422077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601a4bb-9045-4d57-af6b-9f5d7cc48747 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:24.520890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601a4bb-9045-4d57-af6b-9f5d7cc48747 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:24.548088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:24.554636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c1f19-6ee2-4fff-a71b-04d622909c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:24.555300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1f19-6ee2-4fff-a71b-04d622909c3d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:24.555571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1f19-6ee2-4fff-a71b-04d622909c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:24.555837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c1f19-6ee2-4fff-a71b-04d622909c3d None admin] PATH_INFO: `/v3/roles/043adf092a6b422e961a0edc97df0a66` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:24.557187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c1f19-6ee2-4fff-a71b-04d622909c3d None admin] RBAC: Authorizing `identity:get_role(role_id=043adf092a6b422e961a0edc97df0a66)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:24.558542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c1f19-6ee2-4fff-a71b-04d622909c3d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:24.559870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 556/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:24 2022] GET /identity/v3/roles/043adf092a6b422e961a0edc97df0a66 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:24.565585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1951b-dfee-408e-bfa0-b8e4ebf48e1d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:24.615798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:24.662128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1951b-dfee-408e-bfa0-b8e4ebf48e1d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:24.695956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81049a8-f034-41ad-99b8-574ba4444094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:24.696508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81049a8-f034-41ad-99b8-574ba4444094 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:24.696783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81049a8-f034-41ad-99b8-574ba4444094 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:24.697050 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81049a8-f034-41ad-99b8-574ba4444094 None admin] PATH_INFO: `/v3/users/c5057e673a804f43a234ff1d66b5ee97` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:24.698148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81049a8-f034-41ad-99b8-574ba4444094 None admin] RBAC: Authorizing `identity:get_user(user_id=c5057e673a804f43a234ff1d66b5ee97)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:24.699596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81049a8-f034-41ad-99b8-574ba4444094 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:24.701153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 565/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:24 2022] GET /identity/v3/users/c5057e673a804f43a234ff1d66b5ee97 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:24.707097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c1f19-6ee2-4fff-a71b-04d622909c3d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:24.801895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c1f19-6ee2-4fff-a71b-04d622909c3d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:24.835182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb94970-2386-44a3-a886-eb1d79a7e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:24.835788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb94970-2386-44a3-a886-eb1d79a7e613 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:24.836064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb94970-2386-44a3-a886-eb1d79a7e613 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:24.836335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb94970-2386-44a3-a886-eb1d79a7e613 None admin] PATH_INFO: `/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:24.837427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb94970-2386-44a3-a886-eb1d79a7e613 None admin] RBAC: Authorizing `identity:get_project(project_id=8c93d115af0c4a86a1b8b52ac89a7193)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:24.838846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb94970-2386-44a3-a886-eb1d79a7e613 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:24.840436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 557/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:24 2022] GET /identity/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:24.846161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81049a8-f034-41ad-99b8-574ba4444094 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:24.941075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81049a8-f034-41ad-99b8-574ba4444094 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:24.960940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:24.975324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9209c2-75dd-4d9d-9a7f-d6cff27bfe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:24.975948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9209c2-75dd-4d9d-9a7f-d6cff27bfe9c None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:24.976222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9209c2-75dd-4d9d-9a7f-d6cff27bfe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:24.976489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9209c2-75dd-4d9d-9a7f-d6cff27bfe9c None admin] PATH_INFO: `/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193/users/c5057e673a804f43a234ff1d66b5ee97/roles/043adf092a6b422e961a0edc97df0a66` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:24.978576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9209c2-75dd-4d9d-9a7f-d6cff27bfe9c None admin] RBAC: Authorizing `identity:create_grant(project_id=8c93d115af0c4a86a1b8b52ac89a7193, user_id=c5057e673a804f43a234ff1d66b5ee97, role_id=043adf092a6b422e961a0edc97df0a66)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:24.980029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9209c2-75dd-4d9d-9a7f-d6cff27bfe9c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:24.991800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 566/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:49:24 2022] PUT /identity/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193/users/c5057e673a804f43a234ff1d66b5ee97/roles/043adf092a6b422e961a0edc97df0a66 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:49:27.110421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c634bd-8b2f-4fbd-85a0-4d455ef98d4e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:27.111045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c634bd-8b2f-4fbd-85a0-4d455ef98d4e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:27.111139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c634bd-8b2f-4fbd-85a0-4d455ef98d4e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:27.112482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 558/1124] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:27.118141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5d31c-a57d-4ccc-a4f4-84873eaf47fd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:27.118585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5d31c-a57d-4ccc-a4f4-84873eaf47fd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:27.118692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5d31c-a57d-4ccc-a4f4-84873eaf47fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:27.137277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-44e5d31c-a57d-4ccc-a4f4-84873eaf47fd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:27.138440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-44e5d31c-a57d-4ccc-a4f4-84873eaf47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:27.203119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 567/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:27.474226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c634bd-8b2f-4fbd-85a0-4d455ef98d4e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:27.538774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:27.573127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c634bd-8b2f-4fbd-85a0-4d455ef98d4e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:27.605717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb7e66-7948-4e78-aad4-0ea3cb45c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:27.606325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7e66-7948-4e78-aad4-0ea3cb45c918 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:27.606604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7e66-7948-4e78-aad4-0ea3cb45c918 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:27.606900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7e66-7948-4e78-aad4-0ea3cb45c918 None admin] PATH_INFO: `/v3/roles/043adf092a6b422e961a0edc97df0a66` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:27.608265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb7e66-7948-4e78-aad4-0ea3cb45c918 None admin] RBAC: Authorizing `identity:get_role(role_id=043adf092a6b422e961a0edc97df0a66)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:27.609597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb7e66-7948-4e78-aad4-0ea3cb45c918 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:27.610912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 559/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:27 2022] GET /identity/v3/roles/043adf092a6b422e961a0edc97df0a66 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:27.617499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5d31c-a57d-4ccc-a4f4-84873eaf47fd None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:27.713283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5d31c-a57d-4ccc-a4f4-84873eaf47fd None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:27.723500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:27.747936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9f398-ed61-4f29-99d5-b16790a262dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:27.748482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f398-ed61-4f29-99d5-b16790a262dd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:27.748753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f398-ed61-4f29-99d5-b16790a262dd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:27.749018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f398-ed61-4f29-99d5-b16790a262dd None admin] PATH_INFO: `/v3/users/c5057e673a804f43a234ff1d66b5ee97` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:27.750360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9f398-ed61-4f29-99d5-b16790a262dd None admin] RBAC: Authorizing `identity:get_user(user_id=c5057e673a804f43a234ff1d66b5ee97)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:27.751808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9f398-ed61-4f29-99d5-b16790a262dd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:27.753360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 568/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:27 2022] GET /identity/v3/users/c5057e673a804f43a234ff1d66b5ee97 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:27.759222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb7e66-7948-4e78-aad4-0ea3cb45c918 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:27.854651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb7e66-7948-4e78-aad4-0ea3cb45c918 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:27.887560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80748b-4990-4c5b-bc3a-24d5c262c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:27.888141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80748b-4990-4c5b-bc3a-24d5c262c08e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:27.888419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80748b-4990-4c5b-bc3a-24d5c262c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:27.888685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80748b-4990-4c5b-bc3a-24d5c262c08e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:27.891182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:27.954648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80748b-4990-4c5b-bc3a-24d5c262c08e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:27.956099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80748b-4990-4c5b-bc3a-24d5c262c08e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:28.050272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 560/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:49:28.056393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9f398-ed61-4f29-99d5-b16790a262dd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:28.150255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9f398-ed61-4f29-99d5-b16790a262dd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:28.182259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a0e06-eebd-471e-978e-4a7c59c823fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:28.182880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0e06-eebd-471e-978e-4a7c59c823fb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:28.183155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0e06-eebd-471e-978e-4a7c59c823fb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:28.183420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0e06-eebd-471e-978e-4a7c59c823fb None admin] PATH_INFO: `/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:28.184499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a0e06-eebd-471e-978e-4a7c59c823fb None admin] RBAC: Authorizing `identity:get_project(project_id=8c93d115af0c4a86a1b8b52ac89a7193)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:28.185906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a0e06-eebd-471e-978e-4a7c59c823fb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:28.187522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 569/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:28 2022] GET /identity/v3/projects/8c93d115af0c4a86a1b8b52ac89a7193 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:28.193601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80748b-4990-4c5b-bc3a-24d5c262c08e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:28.226598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:28.290667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80748b-4990-4c5b-bc3a-24d5c262c08e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:28.323293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e83b09-15b6-43f9-9855-dabdd84836ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:28.323822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e83b09-15b6-43f9-9855-dabdd84836ce None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:28.324096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e83b09-15b6-43f9-9855-dabdd84836ce None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:28.324369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e83b09-15b6-43f9-9855-dabdd84836ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:28.325080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e83b09-15b6-43f9-9855-dabdd84836ce None admin] RBAC: Adding query filter params (role.id=043adf092a6b422e961a0edc97df0a66, scope.project.id=8c93d115af0c4a86a1b8b52ac89a7193, user.id=c5057e673a804f43a234ff1d66b5ee97) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:28.325387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e83b09-15b6-43f9-9855-dabdd84836ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:28.326805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e83b09-15b6-43f9-9855-dabdd84836ce None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:28.332289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 561/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:28 2022] GET /identity/v3/role_assignments?user.id=c5057e673a804f43a234ff1d66b5ee97&scope.project.id=8c93d115af0c4a86a1b8b52ac89a7193&role.id=043adf092a6b422e961a0edc97df0a66 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:30.467238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d5f22-ad9b-4fd6-ae68-1604b129cb27 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:30.467784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d5f22-ad9b-4fd6-ae68-1604b129cb27 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:30.467784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d5f22-ad9b-4fd6-ae68-1604b129cb27 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:30.469095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 570/1131] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:30.474823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d3fb4-2c98-4675-a344-ad037eaee3ec None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:30.475311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d3fb4-2c98-4675-a344-ad037eaee3ec None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:30.475568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d3fb4-2c98-4675-a344-ad037eaee3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:30.493175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1e2d3fb4-2c98-4675-a344-ad037eaee3ec None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:30.494345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1e2d3fb4-2c98-4675-a344-ad037eaee3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:30.559285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 562/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:30.827976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d5f22-ad9b-4fd6-ae68-1604b129cb27 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:30.874646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:30.925966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d5f22-ad9b-4fd6-ae68-1604b129cb27 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:30.959257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed78c-bb7b-46e3-a3e4-af1ce9887a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:30.959851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed78c-bb7b-46e3-a3e4-af1ce9887a8c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:30.960127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed78c-bb7b-46e3-a3e4-af1ce9887a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:30.960398 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed78c-bb7b-46e3-a3e4-af1ce9887a8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:30.961494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed78c-bb7b-46e3-a3e4-af1ce9887a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:30.962941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed78c-bb7b-46e3-a3e4-af1ce9887a8c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:30.964485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 571/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:30.970337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d3fb4-2c98-4675-a344-ad037eaee3ec None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:30.997362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:31.066438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d3fb4-2c98-4675-a344-ad037eaee3ec None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:31.098806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aca401-434a-4ad7-92b0-f985c3dc8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:31.099444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aca401-434a-4ad7-92b0-f985c3dc8d36 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:31.099717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aca401-434a-4ad7-92b0-f985c3dc8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:31.099984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aca401-434a-4ad7-92b0-f985c3dc8d36 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:31.100626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aca401-434a-4ad7-92b0-f985c3dc8d36 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:31.102022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aca401-434a-4ad7-92b0-f985c3dc8d36 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:31.127701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 563/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:49:30 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:49:33.298108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6715-3394-434c-8627-0c649430e5f4 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:33.298648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6715-3394-434c-8627-0c649430e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:33.298648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6715-3394-434c-8627-0c649430e5f4 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:33.300129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 572/1135] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:33.305511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005b0b6-1fff-4926-9165-48acecea6b1f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:33.305922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005b0b6-1fff-4926-9165-48acecea6b1f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:33.306062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005b0b6-1fff-4926-9165-48acecea6b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:33.323985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e005b0b6-1fff-4926-9165-48acecea6b1f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:33.325165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e005b0b6-1fff-4926-9165-48acecea6b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:33.389920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 564/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:33.663408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f6715-3394-434c-8627-0c649430e5f4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:33.761675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f6715-3394-434c-8627-0c649430e5f4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:33.775909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:33.795813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ceb01-65c7-45a0-b606-3db3dfd93fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:33.796417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ceb01-65c7-45a0-b606-3db3dfd93fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:33.796691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ceb01-65c7-45a0-b606-3db3dfd93fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:33.796957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ceb01-65c7-45a0-b606-3db3dfd93fd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:33.798043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ceb01-65c7-45a0-b606-3db3dfd93fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:33.799491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ceb01-65c7-45a0-b606-3db3dfd93fd7 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:33.801025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 573/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:49:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:33.807503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005b0b6-1fff-4926-9165-48acecea6b1f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:33.819105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:33.904078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005b0b6-1fff-4926-9165-48acecea6b1f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:33.936536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d157d6-7616-4e71-8f7c-f25590bf269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:33.937058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d157d6-7616-4e71-8f7c-f25590bf269f None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:33.937326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d157d6-7616-4e71-8f7c-f25590bf269f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:33.937588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d157d6-7616-4e71-8f7c-f25590bf269f None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:33.938218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d157d6-7616-4e71-8f7c-f25590bf269f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:33.939637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d157d6-7616-4e71-8f7c-f25590bf269f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:33.960671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 565/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:49:33 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:49:36.129190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81c347-dd3e-4eb9-9095-307f0a84105b None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:36.129758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81c347-dd3e-4eb9-9095-307f0a84105b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:36.129758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81c347-dd3e-4eb9-9095-307f0a84105b None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:36.131865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 574/1139] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:36.137096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76189c2-a2a0-46c4-950d-93e1503fe3f4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:36.137517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76189c2-a2a0-46c4-950d-93e1503fe3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:36.137621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76189c2-a2a0-46c4-950d-93e1503fe3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:36.155559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f76189c2-a2a0-46c4-950d-93e1503fe3f4 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:36.156720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f76189c2-a2a0-46c4-950d-93e1503fe3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:36.214104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:36.222314 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 566/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:36.488392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81c347-dd3e-4eb9-9095-307f0a84105b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:36.587905 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81c347-dd3e-4eb9-9095-307f0a84105b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:36.619973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d74a1-b645-4ba7-9c1d-39fd83258ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:36.620586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d74a1-b645-4ba7-9c1d-39fd83258ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:36.620863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d74a1-b645-4ba7-9c1d-39fd83258ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:36.621133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d74a1-b645-4ba7-9c1d-39fd83258ad4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:36.631545 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d74a1-b645-4ba7-9c1d-39fd83258ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-437d74a1-b645-4ba7-9c1d-39fd83258ad4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:36.636288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:36.637356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:36.638254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 575/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:49:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:36.643356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76189c2-a2a0-46c4-950d-93e1503fe3f4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:36.738916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76189c2-a2a0-46c4-950d-93e1503fe3f4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:36.772303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:36.772886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:36.773158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:36.773420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:36.774062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:36.774356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:36.775711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:36.783306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 567/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:49:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:36.789253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d74a1-b645-4ba7-9c1d-39fd83258ad4 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:36.831129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:36.886289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d74a1-b645-4ba7-9c1d-39fd83258ad4 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:36.918074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecf52f-40bc-466e-9587-2fb6210bd89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:36.918672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf52f-40bc-466e-9587-2fb6210bd89b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:36.918975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf52f-40bc-466e-9587-2fb6210bd89b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:36.919244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf52f-40bc-466e-9587-2fb6210bd89b None admin] PATH_INFO: `/v3/users/aa531aeb983146e78bf75601aa45ce39` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:36.932286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecf52f-40bc-466e-9587-2fb6210bd89b None admin] RBAC: Authorizing `identity:get_user(user_id=aa531aeb983146e78bf75601aa45ce39)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:36.933695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecf52f-40bc-466e-9587-2fb6210bd89b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:36.935271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 576/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:36 2022] GET /identity/v3/users/aa531aeb983146e78bf75601aa45ce39 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:36.941120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:36.997713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:37.039605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9df06d-d38b-4fc9-9945-c043cf2223b1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:37.071871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46b082-11ef-42b4-9385-c95cbf4fd576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:37.072451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b082-11ef-42b4-9385-c95cbf4fd576 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:37.072725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b082-11ef-42b4-9385-c95cbf4fd576 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:37.072996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b082-11ef-42b4-9385-c95cbf4fd576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:37.136586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46b082-11ef-42b4-9385-c95cbf4fd576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:37.137991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46b082-11ef-42b4-9385-c95cbf4fd576 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:37.190884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:37.231071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 568/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:49:37.236947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecf52f-40bc-466e-9587-2fb6210bd89b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:37.330644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:37.334649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecf52f-40bc-466e-9587-2fb6210bd89b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:37.367684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc3a8e-86c4-4347-b79d-6e1b2ab064fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:37.368284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc3a8e-86c4-4347-b79d-6e1b2ab064fe None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:37.368561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc3a8e-86c4-4347-b79d-6e1b2ab064fe None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:37.368831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc3a8e-86c4-4347-b79d-6e1b2ab064fe None admin] PATH_INFO: `/v3/projects/3bfb88bf15024f49a609da17c5f6ba19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:37.369930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc3a8e-86c4-4347-b79d-6e1b2ab064fe None admin] RBAC: Authorizing `identity:get_project(project_id=3bfb88bf15024f49a609da17c5f6ba19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:37.371391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc3a8e-86c4-4347-b79d-6e1b2ab064fe None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:37.372994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 577/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:37 2022] GET /identity/v3/projects/3bfb88bf15024f49a609da17c5f6ba19 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:37.379286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46b082-11ef-42b4-9385-c95cbf4fd576 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:37.473546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46b082-11ef-42b4-9385-c95cbf4fd576 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:37.506611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168223c-c32a-433c-adf6-5728c49fc2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:37.507221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168223c-c32a-433c-adf6-5728c49fc2fe None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:37.507494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168223c-c32a-433c-adf6-5728c49fc2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:37.507761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168223c-c32a-433c-adf6-5728c49fc2fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:37.508459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168223c-c32a-433c-adf6-5728c49fc2fe None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=3bfb88bf15024f49a609da17c5f6ba19, user.id=aa531aeb983146e78bf75601aa45ce39) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:37.508761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168223c-c32a-433c-adf6-5728c49fc2fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:37.510151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168223c-c32a-433c-adf6-5728c49fc2fe None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:37.515423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 569/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:37 2022] GET /identity/v3/role_assignments?user.id=aa531aeb983146e78bf75601aa45ce39&scope.project.id=3bfb88bf15024f49a609da17c5f6ba19&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:39.637295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604adba-1455-4e67-82f6-caccf6476d6d None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:39.637865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604adba-1455-4e67-82f6-caccf6476d6d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:39.637865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604adba-1455-4e67-82f6-caccf6476d6d None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:39.639177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 578/1147] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:39.644208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec273c5-9fd1-4362-a28a-7e256dcc8c3f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:39.644626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec273c5-9fd1-4362-a28a-7e256dcc8c3f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:39.644759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec273c5-9fd1-4362-a28a-7e256dcc8c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:39.665736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0ec273c5-9fd1-4362-a28a-7e256dcc8c3f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:39.666950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0ec273c5-9fd1-4362-a28a-7e256dcc8c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:39.683064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:39.731598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 570/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:40.005866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604adba-1455-4e67-82f6-caccf6476d6d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:40.103872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604adba-1455-4e67-82f6-caccf6476d6d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:40.137138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d336a76-aade-437b-ab17-016d2be3b80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:40.137736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d336a76-aade-437b-ab17-016d2be3b80e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:40.138010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d336a76-aade-437b-ab17-016d2be3b80e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:40.138277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d336a76-aade-437b-ab17-016d2be3b80e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:40.148144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d336a76-aade-437b-ab17-016d2be3b80e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-7d336a76-aade-437b-ab17-016d2be3b80e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:40.152813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:40.153873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:40.154786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 579/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:49:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:40.159762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec273c5-9fd1-4362-a28a-7e256dcc8c3f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:40.254727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec273c5-9fd1-4362-a28a-7e256dcc8c3f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:40.287231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:40.287756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:40.288028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:40.288291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:40.288931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:40.289229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:40.290562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:40.298258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 571/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:49:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:40.304172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d336a76-aade-437b-ab17-016d2be3b80e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:40.332189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:40.402409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d336a76-aade-437b-ab17-016d2be3b80e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:40.435544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea740c0-9d02-4ba6-86ee-0ba8e46c5b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:40.436141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea740c0-9d02-4ba6-86ee-0ba8e46c5b37 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:40.436413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea740c0-9d02-4ba6-86ee-0ba8e46c5b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:40.436675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea740c0-9d02-4ba6-86ee-0ba8e46c5b37 None admin] PATH_INFO: `/v3/users/aa531aeb983146e78bf75601aa45ce39` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:40.437832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea740c0-9d02-4ba6-86ee-0ba8e46c5b37 None admin] RBAC: Authorizing `identity:get_user(user_id=aa531aeb983146e78bf75601aa45ce39)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:40.439269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea740c0-9d02-4ba6-86ee-0ba8e46c5b37 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:40.440788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 580/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:40 2022] GET /identity/v3/users/aa531aeb983146e78bf75601aa45ce39 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:40.447316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:40.463658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:40.544119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae2c6-dce9-4e94-a53e-e96f3d4c74bf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:40.576353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8775a0-be56-4a3a-9a4e-d7944e1658c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:40.576963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8775a0-be56-4a3a-9a4e-d7944e1658c5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:40.577236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8775a0-be56-4a3a-9a4e-d7944e1658c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:40.577502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8775a0-be56-4a3a-9a4e-d7944e1658c5 None admin] PATH_INFO: `/v3/projects/3bfb88bf15024f49a609da17c5f6ba19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:40.578588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8775a0-be56-4a3a-9a4e-d7944e1658c5 None admin] RBAC: Authorizing `identity:get_project(project_id=3bfb88bf15024f49a609da17c5f6ba19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:40.580013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8775a0-be56-4a3a-9a4e-d7944e1658c5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:40.581615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 572/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:40 2022] GET /identity/v3/projects/3bfb88bf15024f49a609da17c5f6ba19 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:40.588362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea740c0-9d02-4ba6-86ee-0ba8e46c5b37 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:40.682158 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:40.688281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea740c0-9d02-4ba6-86ee-0ba8e46c5b37 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:40.720652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b4b7e-9907-4b64-93d5-cb7a6da10645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:40.721295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4b7e-9907-4b64-93d5-cb7a6da10645 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:40.721572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4b7e-9907-4b64-93d5-cb7a6da10645 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:40.721843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4b7e-9907-4b64-93d5-cb7a6da10645 None admin] PATH_INFO: `/v3/projects/3bfb88bf15024f49a609da17c5f6ba19/users/aa531aeb983146e78bf75601aa45ce39/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:40.723774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b4b7e-9907-4b64-93d5-cb7a6da10645 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bfb88bf15024f49a609da17c5f6ba19, user_id=aa531aeb983146e78bf75601aa45ce39, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:40.725246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b4b7e-9907-4b64-93d5-cb7a6da10645 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:40.737740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 581/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:49:40 2022] PUT /identity/v3/projects/3bfb88bf15024f49a609da17c5f6ba19/users/aa531aeb983146e78bf75601aa45ce39/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:49:42.857345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a1ee5-3671-4da7-af48-371703f15624 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:42.857918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a1ee5-3671-4da7-af48-371703f15624 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:42.857918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a1ee5-3671-4da7-af48-371703f15624 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:42.859609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 573/1154] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:42.865578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b3b3-6017-49f6-861c-c6128d949f0c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:42.866032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b3b3-6017-49f6-861c-c6128d949f0c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:42.866141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b3b3-6017-49f6-861c-c6128d949f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:42.884665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5d52b3b3-6017-49f6-861c-c6128d949f0c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:42.885843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5d52b3b3-6017-49f6-861c-c6128d949f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:42.952311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 582/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:43.304856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a1ee5-3671-4da7-af48-371703f15624 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:43.413099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:43.433781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a1ee5-3671-4da7-af48-371703f15624 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:43.467124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3083a-f2c0-45da-8083-5d5290bfb962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:43.467874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3083a-f2c0-45da-8083-5d5290bfb962 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:43.468144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3083a-f2c0-45da-8083-5d5290bfb962 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:43.468405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3083a-f2c0-45da-8083-5d5290bfb962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:43.479481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3083a-f2c0-45da-8083-5d5290bfb962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-95c3083a-f2c0-45da-8083-5d5290bfb962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:43.484383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:43.485420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:43.486559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 574/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:49:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:43.492284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b3b3-6017-49f6-861c-c6128d949f0c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:43.579273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:43.596811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b3b3-6017-49f6-861c-c6128d949f0c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:43.640303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:43.640906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:43.641178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:43.641480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:43.642220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:43.642515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:43.644432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:43.659355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 583/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:49:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:43.665339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3083a-f2c0-45da-8083-5d5290bfb962 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:43.776165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3083a-f2c0-45da-8083-5d5290bfb962 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:43.809182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c14a55-3609-4877-b47d-8c147cece09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:43.809788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c14a55-3609-4877-b47d-8c147cece09c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:43.810058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c14a55-3609-4877-b47d-8c147cece09c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:43.810321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c14a55-3609-4877-b47d-8c147cece09c None admin] PATH_INFO: `/v3/users/aa531aeb983146e78bf75601aa45ce39` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:43.811421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c14a55-3609-4877-b47d-8c147cece09c None admin] RBAC: Authorizing `identity:get_user(user_id=aa531aeb983146e78bf75601aa45ce39)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:43.812813 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c14a55-3609-4877-b47d-8c147cece09c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:43.814359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 575/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:43 2022] GET /identity/v3/users/aa531aeb983146e78bf75601aa45ce39 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:43.821009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:43.918442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aff76-0656-4eee-b40b-a25f83573f98 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:43.952463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0ae73-d50e-409b-b01d-9ef1ddc4d234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:43.953054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0ae73-d50e-409b-b01d-9ef1ddc4d234 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:43.953332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0ae73-d50e-409b-b01d-9ef1ddc4d234 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:43.953600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0ae73-d50e-409b-b01d-9ef1ddc4d234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:43.970991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:44.019517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0ae73-d50e-409b-b01d-9ef1ddc4d234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:44.021063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0ae73-d50e-409b-b01d-9ef1ddc4d234 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:44.117334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 584/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:49:44.123176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c14a55-3609-4877-b47d-8c147cece09c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:44.136934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:44.220592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c14a55-3609-4877-b47d-8c147cece09c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:44.253421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803ca86-da61-4f5f-bad3-b1eb579a3248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:44.254026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ca86-da61-4f5f-bad3-b1eb579a3248 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:44.254300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ca86-da61-4f5f-bad3-b1eb579a3248 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:44.254568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ca86-da61-4f5f-bad3-b1eb579a3248 None admin] PATH_INFO: `/v3/projects/3bfb88bf15024f49a609da17c5f6ba19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:44.255714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803ca86-da61-4f5f-bad3-b1eb579a3248 None admin] RBAC: Authorizing `identity:get_project(project_id=3bfb88bf15024f49a609da17c5f6ba19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:44.257112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803ca86-da61-4f5f-bad3-b1eb579a3248 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:44.258697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 576/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:44 2022] GET /identity/v3/projects/3bfb88bf15024f49a609da17c5f6ba19 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:44.264812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0ae73-d50e-409b-b01d-9ef1ddc4d234 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:44.312360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:44.361004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0ae73-d50e-409b-b01d-9ef1ddc4d234 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:44.393079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf79d1e-5c15-4f7b-a37f-b35115760ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:44.393663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf79d1e-5c15-4f7b-a37f-b35115760ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:44.393935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf79d1e-5c15-4f7b-a37f-b35115760ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:44.394203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf79d1e-5c15-4f7b-a37f-b35115760ed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:44.394941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf79d1e-5c15-4f7b-a37f-b35115760ed8 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=3bfb88bf15024f49a609da17c5f6ba19, user.id=aa531aeb983146e78bf75601aa45ce39) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:44.395246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf79d1e-5c15-4f7b-a37f-b35115760ed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:44.397214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf79d1e-5c15-4f7b-a37f-b35115760ed8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:44.402776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 585/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:44 2022] GET /identity/v3/role_assignments?user.id=aa531aeb983146e78bf75601aa45ce39&scope.project.id=3bfb88bf15024f49a609da17c5f6ba19&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:46.546531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4ca5-c48d-4f05-95ef-21a98a40f1bd None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:46.547124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4ca5-c48d-4f05-95ef-21a98a40f1bd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:46.547124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4ca5-c48d-4f05-95ef-21a98a40f1bd None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:46.548452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 577/1162] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:46.553821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db075fe7-d7d6-4059-abc3-1d83328097d0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:46.554271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db075fe7-d7d6-4059-abc3-1d83328097d0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:46.554367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db075fe7-d7d6-4059-abc3-1d83328097d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:46.572518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-db075fe7-d7d6-4059-abc3-1d83328097d0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:46.573768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-db075fe7-d7d6-4059-abc3-1d83328097d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:46.638500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 586/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:46.905489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b4ca5-c48d-4f05-95ef-21a98a40f1bd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:46.986942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:47.009147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b4ca5-c48d-4f05-95ef-21a98a40f1bd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:47.040827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967133-6872-456d-afd1-2aef40d15156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:47.041402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967133-6872-456d-afd1-2aef40d15156 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:47.041674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967133-6872-456d-afd1-2aef40d15156 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:47.041939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967133-6872-456d-afd1-2aef40d15156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:47.106105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967133-6872-456d-afd1-2aef40d15156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:47.107556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967133-6872-456d-afd1-2aef40d15156 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:47.181768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:47.202808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 578/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:49:47.208764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db075fe7-d7d6-4059-abc3-1d83328097d0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:47.250580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:47.305077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db075fe7-d7d6-4059-abc3-1d83328097d0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:47.337749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be093a0-a35d-41aa-9344-c128933fe366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:47.338361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be093a0-a35d-41aa-9344-c128933fe366 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:47.338639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be093a0-a35d-41aa-9344-c128933fe366 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:47.338944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be093a0-a35d-41aa-9344-c128933fe366 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:47.345333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be093a0-a35d-41aa-9344-c128933fe366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:47.346773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be093a0-a35d-41aa-9344-c128933fe366 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-6be093a0-a35d-41aa-9344-c128933fe366 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:47.358413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:47.359693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:49:47.360761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 587/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:49:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:47.365885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967133-6872-456d-afd1-2aef40d15156 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:47.460678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967133-6872-456d-afd1-2aef40d15156 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:47.492491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0719f3-025b-406e-a26f-c5ce01270e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:47.493058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0719f3-025b-406e-a26f-c5ce01270e38 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:47.493330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0719f3-025b-406e-a26f-c5ce01270e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:47.493592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0719f3-025b-406e-a26f-c5ce01270e38 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:47.494207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0719f3-025b-406e-a26f-c5ce01270e38 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:47.494501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0719f3-025b-406e-a26f-c5ce01270e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:47.495857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0719f3-025b-406e-a26f-c5ce01270e38 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:47.502880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 579/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Sat Sep 24 04:49:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:49.652608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561058-0824-4136-8540-5c1f4ae5ef17 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:49.653143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561058-0824-4136-8540-5c1f4ae5ef17 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:49.653143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561058-0824-4136-8540-5c1f4ae5ef17 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:49.654483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 588/1167] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:49.660033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371bf9-82a9-46f1-b69a-5928df1554dc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:49.660033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371bf9-82a9-46f1-b69a-5928df1554dc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:49.660484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371bf9-82a9-46f1-b69a-5928df1554dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:49.678585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a0371bf9-82a9-46f1-b69a-5928df1554dc None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:49.679794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a0371bf9-82a9-46f1-b69a-5928df1554dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:49.713320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:49.743700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 580/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:50.017413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2561058-0824-4136-8540-5c1f4ae5ef17 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:50.115014 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2561058-0824-4136-8540-5c1f4ae5ef17 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:50.116452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:50.150369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953b5b3-eedf-4554-ac35-a227577ad50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:50.150983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953b5b3-eedf-4554-ac35-a227577ad50b None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:50.151260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953b5b3-eedf-4554-ac35-a227577ad50b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:50.151528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953b5b3-eedf-4554-ac35-a227577ad50b None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:50.152184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953b5b3-eedf-4554-ac35-a227577ad50b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:50.153529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953b5b3-eedf-4554-ac35-a227577ad50b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:50.168899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 589/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Sat Sep 24 04:49:50 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:49:52.322691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab619e-f2ee-4766-9e4b-8419401c0f1d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:52.323303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab619e-f2ee-4766-9e4b-8419401c0f1d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:52.323303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab619e-f2ee-4766-9e4b-8419401c0f1d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:52.324619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 581/1170] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:52.329674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac08c9-62f2-4533-b081-a8cc42a647d9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:52.330119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac08c9-62f2-4533-b081-a8cc42a647d9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:52.330224 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac08c9-62f2-4533-b081-a8cc42a647d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:52.348579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-60ac08c9-62f2-4533-b081-a8cc42a647d9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:52.349836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-60ac08c9-62f2-4533-b081-a8cc42a647d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:52.414063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 590/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:52.694447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab619e-f2ee-4766-9e4b-8419401c0f1d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:52.791137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab619e-f2ee-4766-9e4b-8419401c0f1d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:52.823157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198d8b2-9d13-4e26-a8dc-973c8a25ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:52.823756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d8b2-9d13-4e26-a8dc-973c8a25ff04 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:52.824027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d8b2-9d13-4e26-a8dc-973c8a25ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:52.824291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d8b2-9d13-4e26-a8dc-973c8a25ff04 None admin] PATH_INFO: `/v3/domains/d1b9a252bb744770a3438fdb7e0e31a9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:52.834621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198d8b2-9d13-4e26-a8dc-973c8a25ff04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d1b9a252bb744770a3438fdb7e0e31a9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:52.836061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198d8b2-9d13-4e26-a8dc-973c8a25ff04 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:52.837589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 582/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Sat Sep 24 04:49:52 2022] GET /identity/v3/domains/d1b9a252bb744770a3438fdb7e0e31a9 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:52.843272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac08c9-62f2-4533-b081-a8cc42a647d9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:52.930901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:52.941066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac08c9-62f2-4533-b081-a8cc42a647d9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:52.974704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c4442-8e0a-43de-9b4a-7b792bb73d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:52.975317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4442-8e0a-43de-9b4a-7b792bb73d4a None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:52.975593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4442-8e0a-43de-9b4a-7b792bb73d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:52.975859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4442-8e0a-43de-9b4a-7b792bb73d4a None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:52.976504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c4442-8e0a-43de-9b4a-7b792bb73d4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:52.977920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c4442-8e0a-43de-9b4a-7b792bb73d4a None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:53.008031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 591/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:49:52 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:49:55.155661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e739abd-ba2b-4c65-b07e-e145a2756d7a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:55.156217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e739abd-ba2b-4c65-b07e-e145a2756d7a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:55.156217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e739abd-ba2b-4c65-b07e-e145a2756d7a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:55.157514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 583/1174] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:55.163583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1c81-b6b7-461c-b074-627ac8a475bd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:55.163990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1c81-b6b7-461c-b074-627ac8a475bd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:55.164125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1c81-b6b7-461c-b074-627ac8a475bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:55.182011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-842f1c81-b6b7-461c-b074-627ac8a475bd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:55.183203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-842f1c81-b6b7-461c-b074-627ac8a475bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:55.247201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 592/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:55.517399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e739abd-ba2b-4c65-b07e-e145a2756d7a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:55.548027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:55.616642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e739abd-ba2b-4c65-b07e-e145a2756d7a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:55.648785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f934a-b675-4969-9097-37357804d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:55.649400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f934a-b675-4969-9097-37357804d2ee None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:55.649675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f934a-b675-4969-9097-37357804d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:55.649946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f934a-b675-4969-9097-37357804d2ee None admin] PATH_INFO: `/v3/domains/d1b9a252bb744770a3438fdb7e0e31a9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:55.651058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f934a-b675-4969-9097-37357804d2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=d1b9a252bb744770a3438fdb7e0e31a9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:55.652469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f934a-b675-4969-9097-37357804d2ee None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:55.654009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 584/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Sat Sep 24 04:49:55 2022] GET /identity/v3/domains/d1b9a252bb744770a3438fdb7e0e31a9 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:55.659937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1c81-b6b7-461c-b074-627ac8a475bd None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:55.730121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:55.755488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1c81-b6b7-461c-b074-627ac8a475bd None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:55.787581 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136df7a7-4086-4485-bd6b-abd7a4d68b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:55.788109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136df7a7-4086-4485-bd6b-abd7a4d68b53 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:55.788383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136df7a7-4086-4485-bd6b-abd7a4d68b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:55.788653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136df7a7-4086-4485-bd6b-abd7a4d68b53 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:55.789297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136df7a7-4086-4485-bd6b-abd7a4d68b53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:55.790709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136df7a7-4086-4485-bd6b-abd7a4d68b53 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:55.812136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 593/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:49:55 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:49:57.982543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7019f-ac48-4022-a471-f35d7ca85e9d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:57.983088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7019f-ac48-4022-a471-f35d7ca85e9d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:57.983088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7019f-ac48-4022-a471-f35d7ca85e9d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:57.984362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 585/1178] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:49:57.989885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcacd9-96d5-4813-9cd0-14894d96c6b4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:57.990323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcacd9-96d5-4813-9cd0-14894d96c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:57.990424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcacd9-96d5-4813-9cd0-14894d96c6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:58.008811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c7fcacd9-96d5-4813-9cd0-14894d96c6b4 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:49:58.009984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c7fcacd9-96d5-4813-9cd0-14894d96c6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:49:58.074206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 594/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:49:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:49:58.342431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7019f-ac48-4022-a471-f35d7ca85e9d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:58.437609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:58.441531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7019f-ac48-4022-a471-f35d7ca85e9d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:58.473381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f9404-d67d-401f-ae6b-2dae7f549226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:58.474502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f9404-d67d-401f-ae6b-2dae7f549226 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:58.474797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f9404-d67d-401f-ae6b-2dae7f549226 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:58.475069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f9404-d67d-401f-ae6b-2dae7f549226 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:58.485166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f9404-d67d-401f-ae6b-2dae7f549226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a57f9404-d67d-401f-ae6b-2dae7f549226 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:49:58.490588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:49:58.491708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:49:58.492743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 586/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:49:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:49:58.497646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcacd9-96d5-4813-9cd0-14894d96c6b4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:58.554183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:58.596133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcacd9-96d5-4813-9cd0-14894d96c6b4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:58.629801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:58.630686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:58.630988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:58.631256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:58.631904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:58.632202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:58.633553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:58.641220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 595/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:49:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:58.647863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f9404-d67d-401f-ae6b-2dae7f549226 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:58.746025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f9404-d67d-401f-ae6b-2dae7f549226 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:58.778761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456611-93d5-4a40-a894-8c65437ef47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:58.779397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456611-93d5-4a40-a894-8c65437ef47b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:58.779675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456611-93d5-4a40-a894-8c65437ef47b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:58.779979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456611-93d5-4a40-a894-8c65437ef47b None admin] PATH_INFO: `/v3/users/776bb4ce147a4426a43456a4d3c3feeb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:58.793068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456611-93d5-4a40-a894-8c65437ef47b None admin] RBAC: Authorizing `identity:get_user(user_id=776bb4ce147a4426a43456a4d3c3feeb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:58.794486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456611-93d5-4a40-a894-8c65437ef47b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:58.796088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 587/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:49:58 2022] GET /identity/v3/users/776bb4ce147a4426a43456a4d3c3feeb => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:49:58.801894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:58.897788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016878b0-546b-45eb-9591-c79ec1c50eed None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:58.919184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:58.930946 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ead380-44ee-4107-beae-cbb0570efc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:58.931534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead380-44ee-4107-beae-cbb0570efc42 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:58.931805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead380-44ee-4107-beae-cbb0570efc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:58.932069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead380-44ee-4107-beae-cbb0570efc42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:58.996092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ead380-44ee-4107-beae-cbb0570efc42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:58.997556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ead380-44ee-4107-beae-cbb0570efc42 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:59.092192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 596/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:49:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:49:59.098142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456611-93d5-4a40-a894-8c65437ef47b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:59.116505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:59.194417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456611-93d5-4a40-a894-8c65437ef47b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:59.226668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5292e72-e7fa-42a6-81b9-66b36284a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:59.227311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292e72-e7fa-42a6-81b9-66b36284a786 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:59.227586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292e72-e7fa-42a6-81b9-66b36284a786 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:59.227856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292e72-e7fa-42a6-81b9-66b36284a786 None admin] PATH_INFO: `/v3/projects/109227ab42824fe28c6a21a58dde54c5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:59.228949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5292e72-e7fa-42a6-81b9-66b36284a786 None admin] RBAC: Authorizing `identity:get_project(project_id=109227ab42824fe28c6a21a58dde54c5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:59.230348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5292e72-e7fa-42a6-81b9-66b36284a786 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:59.231972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 588/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:49:59 2022] GET /identity/v3/projects/109227ab42824fe28c6a21a58dde54c5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:49:59.238121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ead380-44ee-4107-beae-cbb0570efc42 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:49:59.261972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:49:59.335600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ead380-44ee-4107-beae-cbb0570efc42 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:49:59.368638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1993947-4346-4386-a2cc-4a499e542466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:49:59.369226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1993947-4346-4386-a2cc-4a499e542466 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:49:59.369505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1993947-4346-4386-a2cc-4a499e542466 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:49:59.369777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1993947-4346-4386-a2cc-4a499e542466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:49:59.370493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1993947-4346-4386-a2cc-4a499e542466 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=109227ab42824fe28c6a21a58dde54c5, user.id=776bb4ce147a4426a43456a4d3c3feeb) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:49:59.370827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1993947-4346-4386-a2cc-4a499e542466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:49:59.372253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1993947-4346-4386-a2cc-4a499e542466 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:49:59.377658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 597/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:49:59 2022] GET /identity/v3/role_assignments?user.id=776bb4ce147a4426a43456a4d3c3feeb&scope.project.id=109227ab42824fe28c6a21a58dde54c5&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:50:01.487244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8b9d-92cb-4510-89ca-70a0435e1d68 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:01.487790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8b9d-92cb-4510-89ca-70a0435e1d68 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:01.487790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8b9d-92cb-4510-89ca-70a0435e1d68 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:01.489094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 589/1186] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:50:01.494280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f414fe-f079-4432-820b-0511d96bb630 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:01.494709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f414fe-f079-4432-820b-0511d96bb630 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:01.494842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f414fe-f079-4432-820b-0511d96bb630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:01.513485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a8f414fe-f079-4432-820b-0511d96bb630 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:50:01.514662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a8f414fe-f079-4432-820b-0511d96bb630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:50:01.578048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 598/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:50:01.847195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed8b9d-92cb-4510-89ca-70a0435e1d68 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:01.930546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:01.946095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed8b9d-92cb-4510-89ca-70a0435e1d68 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:01.979903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389879b9-9a12-4aa6-b917-05c6728958c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:01.980506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389879b9-9a12-4aa6-b917-05c6728958c9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:01.980782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389879b9-9a12-4aa6-b917-05c6728958c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:01.981050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389879b9-9a12-4aa6-b917-05c6728958c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:01.990891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389879b9-9a12-4aa6-b917-05c6728958c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-389879b9-9a12-4aa6-b917-05c6728958c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:50:01.995619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:50:01.996718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:50:01.997899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 590/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:50:02.002996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f414fe-f079-4432-820b-0511d96bb630 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:02.021255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:02.099687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f414fe-f079-4432-820b-0511d96bb630 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:02.132586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:02.133174 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:02.133453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:02.133724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:02.134376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:50:02.134681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:02.136063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:02.143750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 599/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:50:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:50:02.150239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389879b9-9a12-4aa6-b917-05c6728958c9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:02.244590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389879b9-9a12-4aa6-b917-05c6728958c9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:02.276319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ad13-f02c-4556-9082-e22e33d38e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:02.276921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ad13-f02c-4556-9082-e22e33d38e33 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:02.277198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ad13-f02c-4556-9082-e22e33d38e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:02.277468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ad13-f02c-4556-9082-e22e33d38e33 None admin] PATH_INFO: `/v3/users/776bb4ce147a4426a43456a4d3c3feeb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:02.278564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920ad13-f02c-4556-9082-e22e33d38e33 None admin] RBAC: Authorizing `identity:get_user(user_id=776bb4ce147a4426a43456a4d3c3feeb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:02.279994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920ad13-f02c-4556-9082-e22e33d38e33 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:02.281524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 591/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:50:02 2022] GET /identity/v3/users/776bb4ce147a4426a43456a4d3c3feeb => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:50:02.287612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:02.365817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:02.387077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6713-111e-402d-8629-37423cdfe87f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:02.419526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc04e7-72d3-4bcf-87b1-18ef9f2cdff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:02.420133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc04e7-72d3-4bcf-87b1-18ef9f2cdff4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:02.420407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc04e7-72d3-4bcf-87b1-18ef9f2cdff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:02.420672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc04e7-72d3-4bcf-87b1-18ef9f2cdff4 None admin] PATH_INFO: `/v3/projects/109227ab42824fe28c6a21a58dde54c5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:02.421765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc04e7-72d3-4bcf-87b1-18ef9f2cdff4 None admin] RBAC: Authorizing `identity:get_project(project_id=109227ab42824fe28c6a21a58dde54c5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:02.423209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc04e7-72d3-4bcf-87b1-18ef9f2cdff4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:02.424795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 600/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:50:02 2022] GET /identity/v3/projects/109227ab42824fe28c6a21a58dde54c5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:50:02.431239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ad13-f02c-4556-9082-e22e33d38e33 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:02.447513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:02.528490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920ad13-f02c-4556-9082-e22e33d38e33 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:02.560635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21982926-716a-420a-bba6-ff011c46a0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:02.561268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21982926-716a-420a-bba6-ff011c46a0b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:02.561540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21982926-716a-420a-bba6-ff011c46a0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:02.561805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21982926-716a-420a-bba6-ff011c46a0b8 None admin] PATH_INFO: `/v3/projects/109227ab42824fe28c6a21a58dde54c5/users/776bb4ce147a4426a43456a4d3c3feeb/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:02.563655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21982926-716a-420a-bba6-ff011c46a0b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=109227ab42824fe28c6a21a58dde54c5, user_id=776bb4ce147a4426a43456a4d3c3feeb, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:02.565045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21982926-716a-420a-bba6-ff011c46a0b8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:02.577988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 592/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:50:02 2022] PUT /identity/v3/projects/109227ab42824fe28c6a21a58dde54c5/users/776bb4ce147a4426a43456a4d3c3feeb/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:50:04.704055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de0cb2-777f-4b47-b945-0618390bca4f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:04.704558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de0cb2-777f-4b47-b945-0618390bca4f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:04.704670 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de0cb2-777f-4b47-b945-0618390bca4f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:04.705934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 601/1193] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:50:04.711171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542feb0-5ec1-4f04-884d-e5d7cf941355 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:04.711571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542feb0-5ec1-4f04-884d-e5d7cf941355 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:04.711711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542feb0-5ec1-4f04-884d-e5d7cf941355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:04.729513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6542feb0-5ec1-4f04-884d-e5d7cf941355 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:50:04.730685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6542feb0-5ec1-4f04-884d-e5d7cf941355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:50:04.794240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 593/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:50:05.065577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de0cb2-777f-4b47-b945-0618390bca4f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:05.162433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de0cb2-777f-4b47-b945-0618390bca4f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:05.194607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f49a-4bf3-4032-a6d3-b9bd660acc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:05.195234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f49a-4bf3-4032-a6d3-b9bd660acc26 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:05.195506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f49a-4bf3-4032-a6d3-b9bd660acc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:05.195772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f49a-4bf3-4032-a6d3-b9bd660acc26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:05.205325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f49a-4bf3-4032-a6d3-b9bd660acc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-05b3f49a-4bf3-4032-a6d3-b9bd660acc26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:50:05.210168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:50:05.211303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:50:05.212195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 602/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:50:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:50:05.217160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542feb0-5ec1-4f04-884d-e5d7cf941355 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:05.220191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:05.316258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542feb0-5ec1-4f04-884d-e5d7cf941355 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:05.349417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:05.349996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:05.350270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:05.350536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:05.351210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:50:05.351509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:05.352856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:05.360485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 594/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:50:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:50:05.366549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f49a-4bf3-4032-a6d3-b9bd660acc26 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:05.375989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:05.463597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f49a-4bf3-4032-a6d3-b9bd660acc26 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:05.495991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db0fd-555d-4af9-bf73-71dda3af81ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:05.496592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db0fd-555d-4af9-bf73-71dda3af81ed None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:05.496864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db0fd-555d-4af9-bf73-71dda3af81ed None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:05.497129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db0fd-555d-4af9-bf73-71dda3af81ed None admin] PATH_INFO: `/v3/users/776bb4ce147a4426a43456a4d3c3feeb` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:05.498214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7db0fd-555d-4af9-bf73-71dda3af81ed None admin] RBAC: Authorizing `identity:get_user(user_id=776bb4ce147a4426a43456a4d3c3feeb)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:05.499648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7db0fd-555d-4af9-bf73-71dda3af81ed None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:05.501445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 603/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 24 04:50:05 2022] GET /identity/v3/users/776bb4ce147a4426a43456a4d3c3feeb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:50:05.507244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:05.571327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:05.605243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cbdd0-7a4c-439c-ad84-111b77a0b8f5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:05.636694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe00ce-a36d-4f7f-a9a3-0d5f9ecb5d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:05.637277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe00ce-a36d-4f7f-a9a3-0d5f9ecb5d58 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:05.637550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe00ce-a36d-4f7f-a9a3-0d5f9ecb5d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:05.637817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe00ce-a36d-4f7f-a9a3-0d5f9ecb5d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:05.703278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe00ce-a36d-4f7f-a9a3-0d5f9ecb5d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:05.704701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe00ce-a36d-4f7f-a9a3-0d5f9ecb5d58 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:05.766194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:05.799570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 595/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:50:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:50:05.806269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db0fd-555d-4af9-bf73-71dda3af81ed None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:05.878664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:05.902476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db0fd-555d-4af9-bf73-71dda3af81ed None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:05.934728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b538a1-3d56-4653-be33-2bcac0a9e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:05.935356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b538a1-3d56-4653-be33-2bcac0a9e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:05.935632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b538a1-3d56-4653-be33-2bcac0a9e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:05.935898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b538a1-3d56-4653-be33-2bcac0a9e9e8 None admin] PATH_INFO: `/v3/projects/109227ab42824fe28c6a21a58dde54c5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:05.936997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b538a1-3d56-4653-be33-2bcac0a9e9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=109227ab42824fe28c6a21a58dde54c5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:05.938411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b538a1-3d56-4653-be33-2bcac0a9e9e8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:05.940034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 604/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 24 04:50:05 2022] GET /identity/v3/projects/109227ab42824fe28c6a21a58dde54c5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:50:05.946043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe00ce-a36d-4f7f-a9a3-0d5f9ecb5d58 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:50:06.040128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe00ce-a36d-4f7f-a9a3-0d5f9ecb5d58 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:50:06.072509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2cf5-2427-4182-a543-e594b3cb91f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:50:06.073088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2cf5-2427-4182-a543-e594b3cb91f7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:50:06.073360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2cf5-2427-4182-a543-e594b3cb91f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:50:06.073626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2cf5-2427-4182-a543-e594b3cb91f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:50:06.074331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2cf5-2427-4182-a543-e594b3cb91f7 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=109227ab42824fe28c6a21a58dde54c5, user.id=776bb4ce147a4426a43456a4d3c3feeb) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:50:06.074635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2cf5-2427-4182-a543-e594b3cb91f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:50:06.076060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c2cf5-2427-4182-a543-e594b3cb91f7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:50:06.081552 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 596/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:50:05 2022] GET /identity/v3/role_assignments?user.id=776bb4ce147a4426a43456a4d3c3feeb&scope.project.id=109227ab42824fe28c6a21a58dde54c5&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:50:15.930881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=29 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:50:16.079070 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:01.866552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dd3d1-ad7c-435e-8113-cb982d72ea11 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:01.867190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dd3d1-ad7c-435e-8113-cb982d72ea11 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:01.867190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dd3d1-ad7c-435e-8113-cb982d72ea11 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:01.868485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 605/1201] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:01.876347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65fcf-ea1e-4899-bbe9-77f9d54f61e3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:01.877165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65fcf-ea1e-4899-bbe9-77f9d54f61e3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:01.877165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65fcf-ea1e-4899-bbe9-77f9d54f61e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:01.898657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b8a65fcf-ea1e-4899-bbe9-77f9d54f61e3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:01.899908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b8a65fcf-ea1e-4899-bbe9-77f9d54f61e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:01.982868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 597/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:02.324015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206dd3d1-ad7c-435e-8113-cb982d72ea11 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:02.462435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206dd3d1-ad7c-435e-8113-cb982d72ea11 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:02.508662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:02.509765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:02.510315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:02.510819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:02.524475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:02.526471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:02.551863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:02.553640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:02.554913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:02.554913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:02.554913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:02.557183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 606/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:51:02.565660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a65fcf-ea1e-4899-bbe9-77f9d54f61e3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:02.682878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a65fcf-ea1e-4899-bbe9-77f9d54f61e3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:02.716376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:02.727966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964b68b-7f3a-4cf2-bf9f-e42eedb8b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:02.728678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964b68b-7f3a-4cf2-bf9f-e42eedb8b01d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:02.728960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964b68b-7f3a-4cf2-bf9f-e42eedb8b01d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:02.729232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964b68b-7f3a-4cf2-bf9f-e42eedb8b01d None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:02.729898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964b68b-7f3a-4cf2-bf9f-e42eedb8b01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:02.730210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964b68b-7f3a-4cf2-bf9f-e42eedb8b01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:02.731600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964b68b-7f3a-4cf2-bf9f-e42eedb8b01d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:02.747264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 598/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:02.756993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:02.818565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:02.881444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe479eb-79a0-4a1c-b338-0d842dc24f5b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:02.923324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082e90d-3abb-4032-a1a8-62921a389e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:02.924028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e90d-3abb-4032-a1a8-62921a389e76 None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:02.924408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e90d-3abb-4032-a1a8-62921a389e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:02.924776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e90d-3abb-4032-a1a8-62921a389e76 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:02.925538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082e90d-3abb-4032-a1a8-62921a389e76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:02.927476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082e90d-3abb-4032-a1a8-62921a389e76 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:02.954798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 607/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 24 04:51:02 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 04:51:05.526589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6df88b-952c-436e-b7a0-3fb36db1034c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:05.527181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6df88b-952c-436e-b7a0-3fb36db1034c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:05.527181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6df88b-952c-436e-b7a0-3fb36db1034c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:05.528531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 599/1206] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:05.534070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43f38-664e-4a9d-aa0f-45b7a9ccdcb6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:05.534535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43f38-664e-4a9d-aa0f-45b7a9ccdcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:05.534635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43f38-664e-4a9d-aa0f-45b7a9ccdcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:05.555561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-73f43f38-664e-4a9d-aa0f-45b7a9ccdcb6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:05.557286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-73f43f38-664e-4a9d-aa0f-45b7a9ccdcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:05.629000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 608/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:05.900170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6df88b-952c-436e-b7a0-3fb36db1034c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:06.014436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6df88b-952c-436e-b7a0-3fb36db1034c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:06.056157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a854c-8c82-4d28-81c9-8740add29377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:06.056848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a854c-8c82-4d28-81c9-8740add29377 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:06.057105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a854c-8c82-4d28-81c9-8740add29377 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:06.057380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a854c-8c82-4d28-81c9-8740add29377 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:06.069709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a854c-8c82-4d28-81c9-8740add29377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5d2a854c-8c82-4d28-81c9-8740add29377 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:51:06.074588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:06.075930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:06.076814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 600/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:51:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:06.081577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43f38-664e-4a9d-aa0f-45b7a9ccdcb6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:06.124825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:06.196973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43f38-664e-4a9d-aa0f-45b7a9ccdcb6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:06.233269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:06.233269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:06.233269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:06.233269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:06.233730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:06.233730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:06.235079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:06.244629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 609/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:51:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:06.251427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a854c-8c82-4d28-81c9-8740add29377 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:06.310514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:06.366060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a854c-8c82-4d28-81c9-8740add29377 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:06.402924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:06.403795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:06.404343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:06.404614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:06.415576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:06.417012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:06.442468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:06.444055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:06.445353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:06.445353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:06.445353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:06.449289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 601/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:06.450637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:06.574208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:06.578332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d022e-6614-4119-b266-12e34dde258e None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:06.618667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:06.619310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:06.619588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:06.619858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:06.620492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:06.620793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:06.622427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:06.643969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 610/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:06.647663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:06.767739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e082c4-d0b5-443e-b54d-8d88e027d4cf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:06.769303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:06.809046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:06.809891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:06.810192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:06.810534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:06.819053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:06.820470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:51:06.831558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:06.832592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:06.839356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 602/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:06.842104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:06.955428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6421e58-7e5e-4d79-8fd6-68a9c8b66351 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:06.995470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:06.996095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:06.996500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:06.996942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:06.997764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:06.998289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:07.000012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:07.023418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 611/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 24 04:51:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:51:07.028917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:07.158610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869f04e-9b29-4c8d-b52a-19070bcec24d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:07.195776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902079-1b8b-4abc-8824-d99622612ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:07.196471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902079-1b8b-4abc-8824-d99622612ced None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:07.196904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902079-1b8b-4abc-8824-d99622612ced None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:07.197207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902079-1b8b-4abc-8824-d99622612ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:07.233925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:07.277661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd902079-1b8b-4abc-8824-d99622612ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:07.279583 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd902079-1b8b-4abc-8824-d99622612ced None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:07.404043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 603/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:51:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 04:51:07.409956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:07.434094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:07.537531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9863-83f2-4c9a-bdb8-efb37f7dc154 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:07.579297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:07.580027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:07.580202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:07.580475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:07.593426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:07.595105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:07.611221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:07.612482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:07.613416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:07.613416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:07.613416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:07.613416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 612/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:07.618808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902079-1b8b-4abc-8824-d99622612ced None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:07.703188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:07.745220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902079-1b8b-4abc-8824-d99622612ced None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:07.786405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:07.787049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:07.787326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:07.787646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:07.788227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:07.788529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:07.789862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:07.801689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 604/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:07.808000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:07.886435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:07.918831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596073b-356c-4a2b-8719-1116fedefccc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:07.954758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:07.955407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:07.955685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:07.955958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:07.962709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:07.964184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:51:07.976233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:07.977451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:07.984595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 613/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:07.985354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:08.098522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f44484-b4b0-4dc8-8990-1a4b12c949be None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:08.122676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:08.135765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b2e98-283f-403f-a437-32fd74b8665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:08.136371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b2e98-283f-403f-a437-32fd74b8665a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:08.136645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b2e98-283f-403f-a437-32fd74b8665a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:08.136939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b2e98-283f-403f-a437-32fd74b8665a None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:08.137602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b2e98-283f-403f-a437-32fd74b8665a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:08.137905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b2e98-283f-403f-a437-32fd74b8665a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:08.139360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b2e98-283f-403f-a437-32fd74b8665a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:08.152128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 605/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:08.158447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:08.264672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffad08-2a4c-4d6e-9f10-374f63039a7c None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:08.295096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:08.303299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fbaa0-93bc-4ecb-8720-76093cf2f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:08.304366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbaa0-93bc-4ecb-8720-76093cf2f234 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:08.304808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbaa0-93bc-4ecb-8720-76093cf2f234 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:08.305470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbaa0-93bc-4ecb-8720-76093cf2f234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:08.306568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fbaa0-93bc-4ecb-8720-76093cf2f234 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=fe631741e1344f08a139c497b5645383) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:08.307193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fbaa0-93bc-4ecb-8720-76093cf2f234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:08.309520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fbaa0-93bc-4ecb-8720-76093cf2f234 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:08.317049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 614/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:51:08 2022] GET /identity/v3/role_assignments?user.id=fe631741e1344f08a139c497b5645383&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:10.678541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e202-f7c6-4ce8-a18c-07b15fb55014 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:10.679182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e202-f7c6-4ce8-a18c-07b15fb55014 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:10.679182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e202-f7c6-4ce8-a18c-07b15fb55014 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:10.680639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 606/1220] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:10.686893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1448e-84bf-4612-9e36-bcd1523004cf None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:10.687351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1448e-84bf-4612-9e36-bcd1523004cf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:10.687541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1448e-84bf-4612-9e36-bcd1523004cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:10.708907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2ad1448e-84bf-4612-9e36-bcd1523004cf None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:10.710266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2ad1448e-84bf-4612-9e36-bcd1523004cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:10.783499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 615/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:11.054513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e202-f7c6-4ce8-a18c-07b15fb55014 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:11.160038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e202-f7c6-4ce8-a18c-07b15fb55014 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:11.197053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63917-f571-4737-aae9-f72649052525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:11.197668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63917-f571-4737-aae9-f72649052525 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:11.197935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63917-f571-4737-aae9-f72649052525 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:11.198198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63917-f571-4737-aae9-f72649052525 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:11.208749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c63917-f571-4737-aae9-f72649052525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c6c63917-f571-4737-aae9-f72649052525 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:51:11.213540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:11.219129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:11.220200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 607/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:11.221032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1448e-84bf-4612-9e36-bcd1523004cf None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:11.328284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1448e-84bf-4612-9e36-bcd1523004cf None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:11.359494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:11.373969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:11.374571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:11.374917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:11.375164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:11.375826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] RBAC: Adding query filter params (name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:11.376125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:11.377732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:11.386003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 616/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:51:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:11.392229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63917-f571-4737-aae9-f72649052525 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:11.439930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:11.499324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63917-f571-4737-aae9-f72649052525 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:11.536394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:11.537065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:11.537343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:11.537615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:11.548297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:11.549714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:11.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:11.566544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:11.568847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:11.568847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:11.568847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:11.568847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 608/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:11.573406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:11.679460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abfa4f-29ff-4bf4-8469-8bf42e73874b None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:11.717820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:11.718549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:11.718659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:11.718964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:11.719596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:11.719897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:11.721266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:11.733873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 617/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:11.740029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:11.838463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:11.846850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ea544-4c96-43b3-a15c-7ac1e3b58a14 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:11.889378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:11.890006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:11.890277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:11.890543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:11.899863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:11.901520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:51:11.914403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:11.915572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:11.916729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 609/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:51:11.921830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:11.972594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:12.029188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dc381-3b67-4687-b976-ca51e77a1417 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:12.064169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:12.064768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:12.065047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:12.065373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:12.066079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:12.066424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:12.068611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:12.086833 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 618/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 24 04:51:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:12.092624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:12.197067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cddccf-d976-4864-bf60-a79379d143ad None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:12.231545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:12.232184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:12.232447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:12.232701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:12.243783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:12.245198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:12.260503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:12.261698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:12.262818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:12.262818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:12.262818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:12.262818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 610/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:12.267418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:12.386082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924972-09cf-4e13-a59e-b9046cb8a445 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:12.388650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:12.425108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:12.425808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:12.426189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:12.426534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:12.427350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:12.427706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:12.429265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:12.441737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 619/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:12.447551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:12.457022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:12.556272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe0cd-7737-4118-8e79-58c1e84703eb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:12.591177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:12.591914 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:12.592248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:12.592524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:12.599307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:12.600761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:51:12.612386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:12.613437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:12.614539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 611/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:12.619829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:12.734444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da0183-66fc-4be1-a222-b23df28f746f None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:12.779730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2cf64-adaf-4320-964b-b668739b9aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:12.780432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2cf64-adaf-4320-964b-b668739b9aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:12.780770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2cf64-adaf-4320-964b-b668739b9aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:12.781077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2cf64-adaf-4320-964b-b668739b9aa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:12.781934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2cf64-adaf-4320-964b-b668739b9aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:12.782247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2cf64-adaf-4320-964b-b668739b9aa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:12.783881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2cf64-adaf-4320-964b-b668739b9aa5 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:12.798485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 620/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:12.805318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:12.880957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:12.919332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f76aa-037b-4448-9a99-68eb9a35a17b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:12.954869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e6539-d309-4d4b-bac5-84089b2c044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:12.955617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6539-d309-4d4b-bac5-84089b2c044e None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:12.955845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6539-d309-4d4b-bac5-84089b2c044e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:12.956164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6539-d309-4d4b-bac5-84089b2c044e None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/fe631741e1344f08a139c497b5645383/roles/7b269dca2b46421da0128d1e2da8d456` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:12.972051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e6539-d309-4d4b-bac5-84089b2c044e None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=fe631741e1344f08a139c497b5645383, role_id=7b269dca2b46421da0128d1e2da8d456)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:12.973657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e6539-d309-4d4b-bac5-84089b2c044e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:12.985893 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 612/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:51:12 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/fe631741e1344f08a139c497b5645383/roles/7b269dca2b46421da0128d1e2da8d456 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 04:51:15.217430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded8ebd-ccc3-470d-aa8b-6fb6242c380d None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:15.218004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded8ebd-ccc3-470d-aa8b-6fb6242c380d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:15.218004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded8ebd-ccc3-470d-aa8b-6fb6242c380d None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:15.219345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 621/1233] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:15.224755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3948e-2356-4357-bc69-593bffa2681a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:15.225251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3948e-2356-4357-bc69-593bffa2681a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:15.225368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3948e-2356-4357-bc69-593bffa2681a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:15.245188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0fa3948e-2356-4357-bc69-593bffa2681a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:15.246372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0fa3948e-2356-4357-bc69-593bffa2681a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:15.315356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 613/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:15.588547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded8ebd-ccc3-470d-aa8b-6fb6242c380d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:15.615851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:15.700162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded8ebd-ccc3-470d-aa8b-6fb6242c380d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:15.735923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e4187-613f-4475-99fe-21e4de3c4719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:15.736543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e4187-613f-4475-99fe-21e4de3c4719 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:15.736813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e4187-613f-4475-99fe-21e4de3c4719 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:15.737084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e4187-613f-4475-99fe-21e4de3c4719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:15.747474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e4187-613f-4475-99fe-21e4de3c4719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e55e4187-613f-4475-99fe-21e4de3c4719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:51:15.752194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:15.754956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:15.755917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 622/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 24 04:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:15.762322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3948e-2356-4357-bc69-593bffa2681a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:15.811581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:15.868811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3948e-2356-4357-bc69-593bffa2681a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:15.905111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:15.905716 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:15.905990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:15.906263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:15.906948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:15.907293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:15.908613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:15.916913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 614/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 24 04:51:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:15.922951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e4187-613f-4475-99fe-21e4de3c4719 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:16.012309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:16.029237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e4187-613f-4475-99fe-21e4de3c4719 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:16.064479 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:16.065111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:16.065396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:16.065662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:16.076869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:16.078313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:16.094685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:16.095947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:16.097196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:16.097196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:16.097196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:16.101168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 623/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:16.102093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:16.210300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd37d8-ab08-4b7b-889e-41bfb3a8dd1f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:16.219495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:16.246285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:16.246970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:16.247196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:16.247467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:16.248211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:16.248540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:16.250157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:16.264370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 615/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:16.271407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:16.391493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b24de-32d7-40b3-ac86-9d4ba52e18bd None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:16.429035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:16.429690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:16.430031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:16.430317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:16.433407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:16.439256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:16.440901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:51:16.454933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:16.456090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:16.457380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 624/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:16.463165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:16.570845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f2a3d-b0db-45dc-9c46-f9d9cef86746 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:16.609766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:16.610364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:16.610635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:16.611072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:16.611828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:16.612137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:16.614096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:16.632610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 616/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 24 04:51:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:16.639002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:16.743350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b9c6-89bc-4882-925c-e9c9dcc61334 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:16.779085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ff6c-0b9d-4a6b-b1ba-b18eb93621a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:16.779854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ff6c-0b9d-4a6b-b1ba-b18eb93621a9 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:16.780127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ff6c-0b9d-4a6b-b1ba-b18eb93621a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:16.780401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ff6c-0b9d-4a6b-b1ba-b18eb93621a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:16.849352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:16.856459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ff6c-0b9d-4a6b-b1ba-b18eb93621a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:16.857915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ff6c-0b9d-4a6b-b1ba-b18eb93621a9 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:16.976629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 625/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:51:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:51:16.984813 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:17.015215 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:17.100028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1be9-a1eb-4154-b141-44f6a7139e07 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:17.138287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:17.138962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:17.139246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:17.139551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:17.150243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:17.151744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:17.170413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:17.171592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:17.172592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:17.172592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:17.172592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:17.172592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 617/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:17.178596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ff6c-0b9d-4a6b-b1ba-b18eb93621a9 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:17.290415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:17.296157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ff6c-0b9d-4a6b-b1ba-b18eb93621a9 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:17.340776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:17.341499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:17.341861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:17.342307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:17.343181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:17.343531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:17.345331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:17.361049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 626/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:17.367400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:17.448182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:17.477190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d535d-a5bc-4964-bbd5-07a3c009deed None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:17.512991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:17.513614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:17.513895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:17.514162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:17.521637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:17.523165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:51:17.535349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:17.537127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:17.538041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 618/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:51:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:51:17.543276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:17.648782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc02c7-646f-43c2-abd3-d52c97752a65 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:17.687198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c9f69-42dd-4065-98f4-44b490ad4048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:17.687818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9f69-42dd-4065-98f4-44b490ad4048 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:17.688080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9f69-42dd-4065-98f4-44b490ad4048 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:17.688354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9f69-42dd-4065-98f4-44b490ad4048 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:17.689062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c9f69-42dd-4065-98f4-44b490ad4048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:17.689335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c9f69-42dd-4065-98f4-44b490ad4048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:17.690826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c9f69-42dd-4065-98f4-44b490ad4048 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:17.703247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 627/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:17.710517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:17.824572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3415-3899-49aa-862e-f7a317eab500 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:17.862087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2aa97-5705-4224-9704-2a3ffdd4c814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:17.862842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2aa97-5705-4224-9704-2a3ffdd4c814 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:17.863120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2aa97-5705-4224-9704-2a3ffdd4c814 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:17.863394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2aa97-5705-4224-9704-2a3ffdd4c814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:17.864820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2aa97-5705-4224-9704-2a3ffdd4c814 None admin] RBAC: Adding query filter params (role.id=7b269dca2b46421da0128d1e2da8d456, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=fe631741e1344f08a139c497b5645383) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:17.865093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2aa97-5705-4224-9704-2a3ffdd4c814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:17.866575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2aa97-5705-4224-9704-2a3ffdd4c814 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:17.873104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 619/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:51:17 2022] GET /identity/v3/role_assignments?user.id=fe631741e1344f08a139c497b5645383&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=7b269dca2b46421da0128d1e2da8d456 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:20.108083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae838f9-a312-4460-a3d8-3a8a89a9a716 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:20.108728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae838f9-a312-4460-a3d8-3a8a89a9a716 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:20.108728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae838f9-a312-4460-a3d8-3a8a89a9a716 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:20.109950 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 628/1247] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:20.116017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f69ce-8218-4c18-997a-ed51ecfffab2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:20.116515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f69ce-8218-4c18-997a-ed51ecfffab2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:20.116617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f69ce-8218-4c18-997a-ed51ecfffab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:20.122798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:20.137688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cf8f69ce-8218-4c18-997a-ed51ecfffab2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:20.139190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cf8f69ce-8218-4c18-997a-ed51ecfffab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:20.212111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 620/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:20.513556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae838f9-a312-4460-a3d8-3a8a89a9a716 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:20.534742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:20.626248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae838f9-a312-4460-a3d8-3a8a89a9a716 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:20.664467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4043f-0554-45a7-b72e-66ca46fd58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:20.665122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4043f-0554-45a7-b72e-66ca46fd58d3 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:20.665404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4043f-0554-45a7-b72e-66ca46fd58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:20.665678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4043f-0554-45a7-b72e-66ca46fd58d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:20.679115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4043f-0554-45a7-b72e-66ca46fd58d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-c8b4043f-0554-45a7-b72e-66ca46fd58d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:51:20.684236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:20.685235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:20.686104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 629/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:20.692514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f69ce-8218-4c18-997a-ed51ecfffab2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:20.805494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f69ce-8218-4c18-997a-ed51ecfffab2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:20.836205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:20.841452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:20.842063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:20.842365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:20.842635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:20.843325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:20.843625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:20.844984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:20.854461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 621/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:20.860588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4043f-0554-45a7-b72e-66ca46fd58d3 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:20.944621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:20.968107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4043f-0554-45a7-b72e-66ca46fd58d3 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:21.003972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:21.004816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:21.005130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:21.005403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:21.016511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:21.017987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:21.034849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:21.036637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:21.037580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:21.037580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:21.037580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:21.037580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 630/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:21.043014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:21.157698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bebc1-098f-40a4-9ae9-9069140ed31d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:21.192308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:21.192899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:21.193176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:21.193447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:21.194081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:21.194383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:21.195796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:21.208190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 622/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:21.214088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:21.321955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269eb8b-f223-4e61-a786-2ab8e2fd275d None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:21.356588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:21.368142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:21.368772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:21.369050 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:21.369322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:21.377186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:21.378923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:51:21.390175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:21.391194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:21.392462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 631/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:21.398019 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:21.454434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:21.498371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d59c6-3c9b-41d6-a783-4db67c3e7d0c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:21.532015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:21.532600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:21.532872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:21.533136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:21.533846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:21.534147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:21.535609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:21.552738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 623/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 24 04:51:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:21.558525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:21.654990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05674ce7-e47f-405b-af68-5e5765a1c768 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:21.687278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801da6d-0eb0-4e1b-a0f6-93b9de86e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:21.687866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801da6d-0eb0-4e1b-a0f6-93b9de86e9cf None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:21.688141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801da6d-0eb0-4e1b-a0f6-93b9de86e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:21.688409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801da6d-0eb0-4e1b-a0f6-93b9de86e9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:21.741135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:21.753200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801da6d-0eb0-4e1b-a0f6-93b9de86e9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:21.755330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801da6d-0eb0-4e1b-a0f6-93b9de86e9cf None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:21.848180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 632/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:51:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:51:21.854018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:21.952367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8dd0-4e00-491a-8211-84a2495e6f93 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:21.965017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:21.985146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:21.985757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:21.986032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:21.986301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:21.996454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:21.997808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:22.012617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:22.013730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:22.015013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:22.015013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:22.015013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:22.015013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 624/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:22.019297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801da6d-0eb0-4e1b-a0f6-93b9de86e9cf None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:22.101778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:22.113476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801da6d-0eb0-4e1b-a0f6-93b9de86e9cf None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:22.146814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:22.147393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:22.147670 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:22.147938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:22.148568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:22.148868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:22.150212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:22.161643 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 633/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:22.167230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:22.264444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2d6a-7bb8-4ef0-a72e-013b67f25724 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:22.296966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:22.297565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:22.297836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:22.298105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:22.305274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:22.307238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:51:22.320673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:22.321742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:22.322898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 625/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:22.328050 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:22.430726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f0b7f-0a21-4d50-b567-1ed7c0d3b848 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:22.463173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b99f7e-b8bf-44aa-89cd-9d29af8c80c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:22.463762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b99f7e-b8bf-44aa-89cd-9d29af8c80c8 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:22.464036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b99f7e-b8bf-44aa-89cd-9d29af8c80c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:22.464300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b99f7e-b8bf-44aa-89cd-9d29af8c80c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:22.464986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b99f7e-b8bf-44aa-89cd-9d29af8c80c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:22.465288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b99f7e-b8bf-44aa-89cd-9d29af8c80c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:22.466698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b99f7e-b8bf-44aa-89cd-9d29af8c80c8 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:22.478148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 634/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:22.484308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:22.509764 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:22.580602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767292c5-8450-43d5-916b-34533ae6cdc4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:22.612283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6733a3-e319-4ccf-bc7c-d7461578a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:22.612860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6733a3-e319-4ccf-bc7c-d7461578a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:22.613131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6733a3-e319-4ccf-bc7c-d7461578a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:22.613395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6733a3-e319-4ccf-bc7c-d7461578a1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:22.614663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6733a3-e319-4ccf-bc7c-d7461578a1e7 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=fe631741e1344f08a139c497b5645383) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:22.614990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6733a3-e319-4ccf-bc7c-d7461578a1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:22.616382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6733a3-e319-4ccf-bc7c-d7461578a1e7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:22.621454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 626/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:51:22 2022] GET /identity/v3/role_assignments?user.id=fe631741e1344f08a139c497b5645383&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:24.732916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d7f2-76a8-4ccc-b17e-bf6a92852255 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:24.733438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d7f2-76a8-4ccc-b17e-bf6a92852255 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:24.733438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d7f2-76a8-4ccc-b17e-bf6a92852255 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:24.734808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 635/1261] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:24.739911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacdbf3-91db-4bef-8731-f240bd96f96d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:24.740365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacdbf3-91db-4bef-8731-f240bd96f96d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:24.740461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacdbf3-91db-4bef-8731-f240bd96f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:24.759188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-beacdbf3-91db-4bef-8731-f240bd96f96d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:24.760374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-beacdbf3-91db-4bef-8731-f240bd96f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:24.824126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 627/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:25.096232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d7f2-76a8-4ccc-b17e-bf6a92852255 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:25.107705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:25.195817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d7f2-76a8-4ccc-b17e-bf6a92852255 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:25.229086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d24177-67d9-45bf-8872-0bf195236698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:25.229696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d24177-67d9-45bf-8872-0bf195236698 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:25.229976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d24177-67d9-45bf-8872-0bf195236698 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:25.230247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d24177-67d9-45bf-8872-0bf195236698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:25.240333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d24177-67d9-45bf-8872-0bf195236698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-e4d24177-67d9-45bf-8872-0bf195236698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:51:25.245068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:25.246133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:25.247344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 636/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:51:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:25.252107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacdbf3-91db-4bef-8731-f240bd96f96d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:25.271172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:25.357423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacdbf3-91db-4bef-8731-f240bd96f96d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:25.397957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:25.398616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:25.398922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:25.399191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:25.399841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:25.400139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:25.401482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:25.409407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 628/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:51:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:25.415501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d24177-67d9-45bf-8872-0bf195236698 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:25.480313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:25.512766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d24177-67d9-45bf-8872-0bf195236698 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:25.545326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:25.545933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:25.546209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:25.546480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:25.556378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:25.557812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:25.573183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:25.574296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:25.575257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:25.575257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:25.575257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:25.575257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 637/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:25.580076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:25.658061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:25.677317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdb0d6-e13b-442a-82c9-22f9c7907b41 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:25.709444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:25.710031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:25.710303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:25.710568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:25.711223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:25.711523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:25.712854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:25.724013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 629/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:25.729719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:25.826707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afd93-ee7c-494a-8d02-a15abbde8cc2 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:25.845475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:25.859638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:25.860244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:25.860518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:25.860786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:25.868458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:25.869883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:51:25.881548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:25.882656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:25.883973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 638/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:25.888292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:25.984024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f92f6b-d09b-412f-afd5-0f85cd5d09a6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:26.016757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:26.017339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:26.017616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:26.017886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:26.018594 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:26.018926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:26.020360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:26.028618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:26.037826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 630/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 24 04:51:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:26.043676 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:26.140077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8d677-b638-4254-b5bb-aaf17a60b1dc None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:26.172420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:26.173020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:26.173294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:26.173558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:26.184109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:26.185532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:26.199102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:26.200219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:26.201330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:26.201330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:26.201330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:26.201330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 639/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:26.205888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:26.301007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87abc6b-5b65-41ed-b8d3-45a9bf1fbb63 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:26.339554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:26.340157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:26.340434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:26.340705 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:26.341340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:26.341642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:26.343012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:26.354498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 631/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:26.360152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:26.390723 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:26.457229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807add-e341-48bc-8950-0c18f884b718 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:26.490291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:26.490918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:26.491200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:26.491470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:26.497856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:26.499317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:51:26.510504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:26.511575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:26.512700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 640/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:26.517577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:26.574304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:26.615881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62124a79-cd06-455b-89b7-66f9ada6df50 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:26.648187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e194202-bd04-4207-a9ff-c953bc5a94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:26.648830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194202-bd04-4207-a9ff-c953bc5a94ac None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:26.649108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194202-bd04-4207-a9ff-c953bc5a94ac None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:26.649381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e194202-bd04-4207-a9ff-c953bc5a94ac None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:26.650059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e194202-bd04-4207-a9ff-c953bc5a94ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:26.650368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e194202-bd04-4207-a9ff-c953bc5a94ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:26.651798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e194202-bd04-4207-a9ff-c953bc5a94ac None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:26.664355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 632/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:26.670302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:26.758770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:26.767792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acb970-d445-431a-8033-1fa1872baa03 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:26.800481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397e47c-08d0-4a38-9b0a-dadb500be837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:26.801230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397e47c-08d0-4a38-9b0a-dadb500be837 None admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:26.801528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397e47c-08d0-4a38-9b0a-dadb500be837 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:26.801797 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397e47c-08d0-4a38-9b0a-dadb500be837 None admin] PATH_INFO: `/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/fe631741e1344f08a139c497b5645383/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:26.803711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397e47c-08d0-4a38-9b0a-dadb500be837 None admin] RBAC: Authorizing `identity:create_grant(project_id=37daef16cf3e4435acd2508ceaf4ce1c, user_id=fe631741e1344f08a139c497b5645383, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:26.805135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397e47c-08d0-4a38-9b0a-dadb500be837 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:26.817667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 641/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 24 04:51:26 2022] PUT /identity/v3/projects/37daef16cf3e4435acd2508ceaf4ce1c/users/fe631741e1344f08a139c497b5645383/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:51:28.928307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9b38-e2f0-45c2-9255-73f835ad6b8a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:28.928821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9b38-e2f0-45c2-9255-73f835ad6b8a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:28.928821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9b38-e2f0-45c2-9255-73f835ad6b8a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:28.930094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 633/1274] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:28.936357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e11005-b259-4632-a2d3-06605536e42c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:28.936755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e11005-b259-4632-a2d3-06605536e42c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:28.936906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e11005-b259-4632-a2d3-06605536e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:28.955121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-66e11005-b259-4632-a2d3-06605536e42c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:28.956296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-66e11005-b259-4632-a2d3-06605536e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:29.020201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 642/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:29.287117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9b38-e2f0-45c2-9255-73f835ad6b8a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:29.392843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9b38-e2f0-45c2-9255-73f835ad6b8a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:29.409931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:29.426370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7e4dc-632e-4755-bd07-075aa03e630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:29.427018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7e4dc-632e-4755-bd07-075aa03e630f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:29.427288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7e4dc-632e-4755-bd07-075aa03e630f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:29.427554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7e4dc-632e-4755-bd07-075aa03e630f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:29.437149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7e4dc-632e-4755-bd07-075aa03e630f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bee7e4dc-632e-4755-bd07-075aa03e630f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 04:51:29.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:29.443025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:29.444034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 634/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 24 04:51:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:51:29.448976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e11005-b259-4632-a2d3-06605536e42c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:29.527314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:29.546288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e11005-b259-4632-a2d3-06605536e42c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:29.578450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:29.579076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:29.579354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:29.579623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:29.580278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:29.580578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:29.581935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:29.590183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 643/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 24 04:51:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:29.595968 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7e4dc-632e-4755-bd07-075aa03e630f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:29.694501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7e4dc-632e-4755-bd07-075aa03e630f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:29.726979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:29.727584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:29.727853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:29.728116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:29.737517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:29.739812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:29.753809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:29.755262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:29.756214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:29.756214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:29.756214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:29.756214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 635/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:29.761046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:29.857702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aadd8b-e99d-4fb8-add3-d9d683b0a600 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:29.890217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:29.890823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:29.891107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:29.891374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:29.892005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:29.892304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:29.893646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:29.905160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 644/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:29.911365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:29.940686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:30.007602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfa3d4-a3c9-4273-90ca-3bffedfca3ea None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:30.039796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:30.040407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:30.040681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:30.040947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:30.048019 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:30.049421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 04:51:30.060402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:30.061534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:30.062652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 636/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:30.067854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:30.071571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:30.165374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83442e-2a6f-4521-9f5f-a931e4280035 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:30.198557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:30.199175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:30.199453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:30.199721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:30.200434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:30.200738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:30.202157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:30.218574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 645/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 24 04:51:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:30.224400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:30.312194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:30.322086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b12542-e97c-40a4-aa0f-a1328af6c8d4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:30.355126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba21b8-5630-4cf7-a7b5-042d13268483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:30.355709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba21b8-5630-4cf7-a7b5-042d13268483 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:30.355986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba21b8-5630-4cf7-a7b5-042d13268483 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:30.356252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba21b8-5630-4cf7-a7b5-042d13268483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:30.420148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba21b8-5630-4cf7-a7b5-042d13268483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:30.421502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba21b8-5630-4cf7-a7b5-042d13268483 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:30.505084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:30.514887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 637/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 24 04:51:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 04:51:30.521685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:30.580316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:30.617913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460be3e5-7ff3-45de-9ca3-d1ebf1b8af09 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:30.651312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:30.651929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:30.652202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:30.652465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:30.662431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:30.663892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 04:51:30.677848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:30.678995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 04:51:30.679896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 04:51:30.679896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 04:51:30.679896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:30.679896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 646/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 04:51:30.684510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba21b8-5630-4cf7-a7b5-042d13268483 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:30.778920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba21b8-5630-4cf7-a7b5-042d13268483 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:30.810351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:30.810951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:30.811221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:30.811484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:30.812100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:30.812393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:30.813724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:30.824912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 638/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 24 04:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:51:30.830355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:30.925293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e65542-eaf3-47fb-9d3b-aa270b0c7308 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:30.938721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:30.958623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:30.959250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:30.959523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:30.959789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:30.966082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:30.967521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 04:51:30.978372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:30.979534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: ERROR keystone.server.flask.application Sep 24 04:51:30.980455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 647/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 24 04:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:30.985172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:31.033880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:31.082355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b4da4-4fdd-4f33-9e9f-1538f741fed1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:31.114428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48558ee3-1909-4991-a26c-f995d9d00ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:31.115039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558ee3-1909-4991-a26c-f995d9d00ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:31.115313 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558ee3-1909-4991-a26c-f995d9d00ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:31.115580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558ee3-1909-4991-a26c-f995d9d00ba9 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:31.116253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48558ee3-1909-4991-a26c-f995d9d00ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:31.116555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48558ee3-1909-4991-a26c-f995d9d00ba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:31.117941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48558ee3-1909-4991-a26c-f995d9d00ba9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:31.129692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 639/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 24 04:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:31.135748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:31.242403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e7e83-9a5e-4061-ba8c-c64cd6b0b4cb None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:31.275496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28c47f-1016-4c4b-9456-efa79c06fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:31.276080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c47f-1016-4c4b-9456-efa79c06fe53 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:31.276356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c47f-1016-4c4b-9456-efa79c06fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:31.276623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c47f-1016-4c4b-9456-efa79c06fe53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:31.277334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28c47f-1016-4c4b-9456-efa79c06fe53 None admin] RBAC: Adding query filter params (role.id=278a30c0c1124ebe8c0a3e230255420c, scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c, user.id=fe631741e1344f08a139c497b5645383) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:31.277638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28c47f-1016-4c4b-9456-efa79c06fe53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:31.279068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28c47f-1016-4c4b-9456-efa79c06fe53 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:31.284578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 648/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 24 04:51:31 2022] GET /identity/v3/role_assignments?user.id=fe631741e1344f08a139c497b5645383&scope.project.id=37daef16cf3e4435acd2508ceaf4ce1c&role.id=278a30c0c1124ebe8c0a3e230255420c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:33.436914 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3ab6-4cb6-4d4e-9d86-e5f8b4e36adc None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:33.437460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3ab6-4cb6-4d4e-9d86-e5f8b4e36adc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:33.437460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3ab6-4cb6-4d4e-9d86-e5f8b4e36adc None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:33.438815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 640/1288] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:33.444459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7418-2ae9-455c-a89e-d972f97f6858 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:33.444883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7418-2ae9-455c-a89e-d972f97f6858 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:33.445126 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7418-2ae9-455c-a89e-d972f97f6858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:33.462782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cb2b7418-2ae9-455c-a89e-d972f97f6858 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:33.463950 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cb2b7418-2ae9-455c-a89e-d972f97f6858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:33.492745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:33.528494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 649/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 04:51:33.800398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3ab6-4cb6-4d4e-9d86-e5f8b4e36adc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:33.898670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3ab6-4cb6-4d4e-9d86-e5f8b4e36adc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:33.908836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:33.932469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:33.933099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:33.933373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:33.933642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:33.934210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:33.935569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:33.944148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:33.945383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:33.946316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 641/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:51:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:33.951262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b7418-2ae9-455c-a89e-d972f97f6858 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:34.047613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b7418-2ae9-455c-a89e-d972f97f6858 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:34.079858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2facb54-932c-4a78-ad2b-80aacd0d42d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:34.080378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2facb54-932c-4a78-ad2b-80aacd0d42d4 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:34.080654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2facb54-932c-4a78-ad2b-80aacd0d42d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:34.080917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2facb54-932c-4a78-ad2b-80aacd0d42d4 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:34.081527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2facb54-932c-4a78-ad2b-80aacd0d42d4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:34.081825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2facb54-932c-4a78-ad2b-80aacd0d42d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:34.083952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2facb54-932c-4a78-ad2b-80aacd0d42d4 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:34.088499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 650/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Sep 24 04:51:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 04:51:34.094299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:34.190516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcad80-5622-4d1c-8d85-90cb1ddddd16 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:34.222702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dced969-255a-4a35-83c1-dd880cf75f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:34.223660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dced969-255a-4a35-83c1-dd880cf75f14 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:34.223936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dced969-255a-4a35-83c1-dd880cf75f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:34.224203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dced969-255a-4a35-83c1-dd880cf75f14 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:34.224815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dced969-255a-4a35-83c1-dd880cf75f14 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:34.225114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dced969-255a-4a35-83c1-dd880cf75f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:34.226452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dced969-255a-4a35-83c1-dd880cf75f14 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:34.230662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 642/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Sep 24 04:51:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:36.355396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c144-dfdb-4641-8a84-46144893b7bc None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:36.355939 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c144-dfdb-4641-8a84-46144893b7bc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:36.356096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c144-dfdb-4641-8a84-46144893b7bc None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:36.357747 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 651/1293] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:36.363192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9857b-2a6a-447b-a7b6-9f40d65931ca None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:36.364272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9857b-2a6a-447b-a7b6-9f40d65931ca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:36.364466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9857b-2a6a-447b-a7b6-9f40d65931ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:36.383890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ced9857b-2a6a-447b-a7b6-9f40d65931ca None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:36.385067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ced9857b-2a6a-447b-a7b6-9f40d65931ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:36.413126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:36.449882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 643/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:36.715545 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3c144-dfdb-4641-8a84-46144893b7bc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:36.745349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:36.813308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3c144-dfdb-4641-8a84-46144893b7bc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:36.845267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cddbc8-8371-410f-b811-38db5790ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:36.845851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cddbc8-8371-410f-b811-38db5790ca3b None admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:36.846123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cddbc8-8371-410f-b811-38db5790ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:36.846387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cddbc8-8371-410f-b811-38db5790ca3b None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:36.847045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cddbc8-8371-410f-b811-38db5790ca3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:36.848973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cddbc8-8371-410f-b811-38db5790ca3b None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:36.862573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 652/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 24 04:51:36 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:51:39.004741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5107e-6e9f-4c22-a154-96cb17bb7b0f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:39.005278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5107e-6e9f-4c22-a154-96cb17bb7b0f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:39.005510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5107e-6e9f-4c22-a154-96cb17bb7b0f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:39.006869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 644/1296] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:39.011951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1499-6963-42c9-9960-ad20923c4d1c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:39.012377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1499-6963-42c9-9960-ad20923c4d1c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:39.012480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1499-6963-42c9-9960-ad20923c4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:39.030222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c14e1499-6963-42c9-9960-ad20923c4d1c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:39.031421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c14e1499-6963-42c9-9960-ad20923c4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:39.102228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 653/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:39.372309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5107e-6e9f-4c22-a154-96cb17bb7b0f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:39.470051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5107e-6e9f-4c22-a154-96cb17bb7b0f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:39.502645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:39.503537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:39.503811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:39.504597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:39.505167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:39.506502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:39.514958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:39.516229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:39.517376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 645/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:51:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:39.522616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e1499-6963-42c9-9960-ad20923c4d1c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:39.540392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:39.619215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e1499-6963-42c9-9960-ad20923c4d1c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:39.652690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:39.653214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:39.653487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:39.653757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:39.654372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:39.654668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:39.656067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:39.661331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 654/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Sep 24 04:51:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:39.667182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:39.698282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:39.765718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225a81e-678c-47e9-87d1-46af5a3ecee3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:39.797907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eff3e4-2a7f-4bbb-959b-4b858f94d30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:39.798487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eff3e4-2a7f-4bbb-959b-4b858f94d30e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:39.798776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eff3e4-2a7f-4bbb-959b-4b858f94d30e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:39.799051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eff3e4-2a7f-4bbb-959b-4b858f94d30e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:39.799728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eff3e4-2a7f-4bbb-959b-4b858f94d30e None admin] RBAC: Adding query filter params (interface=public, service_id=e041d8a2defa4711bba1b754399ec708, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:39.800028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eff3e4-2a7f-4bbb-959b-4b858f94d30e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:39.801725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eff3e4-2a7f-4bbb-959b-4b858f94d30e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:39.806523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 646/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 24 04:51:39 2022] GET /identity/v3/endpoints?service_id=e041d8a2defa4711bba1b754399ec708&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:39.812071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:39.892733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:39.910359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c10327-718f-4831-a74b-fe75a2b8fa85 None admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:39.943433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db51ea4-48ce-4c81-827c-f8c5497d9973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:39.944026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db51ea4-48ce-4c81-827c-f8c5497d9973 None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:39.944304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db51ea4-48ce-4c81-827c-f8c5497d9973 None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:39.944576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db51ea4-48ce-4c81-827c-f8c5497d9973 None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:39.945169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db51ea4-48ce-4c81-827c-f8c5497d9973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:39.946518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db51ea4-48ce-4c81-827c-f8c5497d9973 None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:39.953059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 655/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 24 04:51:39 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 04:51:42.111244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4f91a-9ca4-4689-8519-0d1174221ba1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:42.111816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4f91a-9ca4-4689-8519-0d1174221ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:42.111816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4f91a-9ca4-4689-8519-0d1174221ba1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:42.113125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 647/1302] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:51:42.119741 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432ff0-e90c-443c-b92e-44e2ba646b12 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:42.120142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432ff0-e90c-443c-b92e-44e2ba646b12 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:42.120283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432ff0-e90c-443c-b92e-44e2ba646b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:42.138996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-12432ff0-e90c-443c-b92e-44e2ba646b12 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:51:42.140172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-12432ff0-e90c-443c-b92e-44e2ba646b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:51:42.204273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 656/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:51:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 04:51:42.467844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4f91a-9ca4-4689-8519-0d1174221ba1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:42.560883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:42.568818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4f91a-9ca4-4689-8519-0d1174221ba1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:42.601149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:42.601752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:42.602027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:42.602291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:42.602891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:42.604229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 04:51:42.612785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 04:51:42.613969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Sep 24 04:51:42.614846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 648/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 24 04:51:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 04:51:42.619889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12432ff0-e90c-443c-b92e-44e2ba646b12 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:42.694272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:42.717479 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12432ff0-e90c-443c-b92e-44e2ba646b12 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:42.749685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fa159-40b7-4d7e-b7f5-931c964d0e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:42.750225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa159-40b7-4d7e-b7f5-931c964d0e3d None admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:42.750500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa159-40b7-4d7e-b7f5-931c964d0e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:42.750788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa159-40b7-4d7e-b7f5-931c964d0e3d None admin] PATH_INFO: `/v3/services` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:42.751411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fa159-40b7-4d7e-b7f5-931c964d0e3d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:51:42.751713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fa159-40b7-4d7e-b7f5-931c964d0e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:42.753065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fa159-40b7-4d7e-b7f5-931c964d0e3d None admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:42.758934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 657/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Sep 24 04:51:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:51:42.764643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:51:42.861570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5e500-669f-4773-ba99-61f721042ba5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:51:42.894857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355fd26-9730-4ff9-9f1e-7575a3aa147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:51:42.895629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355fd26-9730-4ff9-9f1e-7575a3aa147d None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:51:42.895902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355fd26-9730-4ff9-9f1e-7575a3aa147d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:51:42.896165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355fd26-9730-4ff9-9f1e-7575a3aa147d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:51:42.896806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355fd26-9730-4ff9-9f1e-7575a3aa147d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:51:42.898131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355fd26-9730-4ff9-9f1e-7575a3aa147d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:51:42.916488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 649/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:51:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:51:52.756083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=30 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:51:52.912491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:52:46.985824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dcddd-53d4-4a1e-a37e-2feccb17d027 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:46.986311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dcddd-53d4-4a1e-a37e-2feccb17d027 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:46.986540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dcddd-53d4-4a1e-a37e-2feccb17d027 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:46.988142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 658/1307] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:52:46.993134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b649cc-6a25-4226-8db0-c500b05567e0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:46.993547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b649cc-6a25-4226-8db0-c500b05567e0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:46.993731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b649cc-6a25-4226-8db0-c500b05567e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:47.121384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-21b649cc-6a25-4226-8db0-c500b05567e0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:52:47.122603 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-21b649cc-6a25-4226-8db0-c500b05567e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:47.234887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 650/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:52:47.546428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108e319-812f-4962-bf02-b91ffb3bf256 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:47.546706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108e319-812f-4962-bf02-b91ffb3bf256 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:47.547166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108e319-812f-4962-bf02-b91ffb3bf256 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:47.548636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 659/1309] 10.222.0.26 () {54 vars in 964 bytes} [Sat Sep 24 04:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:52:47.555624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41682-8f1d-422e-a275-cc1c3e44f321 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:47.556355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41682-8f1d-422e-a275-cc1c3e44f321 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:47.556626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41682-8f1d-422e-a275-cc1c3e44f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:47.641835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ddb41682-8f1d-422e-a275-cc1c3e44f321 None None] MFA Rules not processed for user `f50dc809ff034866a1f6343e5b32609b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:52:47.646025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ddb41682-8f1d-422e-a275-cc1c3e44f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:47.672954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:52:47.734192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 651/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Sep 24 04:52:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:52:47.743984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108e319-812f-4962-bf02-b91ffb3bf256 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:52:47.745722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0108e319-812f-4962-bf02-b91ffb3bf256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:47.858431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108e319-812f-4962-bf02-b91ffb3bf256 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:52:47.937796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb812e-6b76-4db9-b2df-7aa3d36086ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:52:47.938411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb812e-6b76-4db9-b2df-7aa3d36086ad service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:47.938680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb812e-6b76-4db9-b2df-7aa3d36086ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:47.938996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb812e-6b76-4db9-b2df-7aa3d36086ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:47.940597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-37eb812e-6b76-4db9-b2df-7aa3d36086ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:47.998299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:52:48.058674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb812e-6b76-4db9-b2df-7aa3d36086ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:52:48.060171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb812e-6b76-4db9-b2df-7aa3d36086ad service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:52:48.081042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 660/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:52:50.543468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b1e6-46b3-48bc-9f4e-effc98edcdd4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:50.544017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b1e6-46b3-48bc-9f4e-effc98edcdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:50.544017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b1e6-46b3-48bc-9f4e-effc98edcdd4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:50.545347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 652/1312] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:52:50.551335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d52d-e95b-4aa9-89fc-676fd422840d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:50.551784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d52d-e95b-4aa9-89fc-676fd422840d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:50.551931 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d52d-e95b-4aa9-89fc-676fd422840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:50.624113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-df47d52d-e95b-4aa9-89fc-676fd422840d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:52:50.625315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-df47d52d-e95b-4aa9-89fc-676fd422840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:50.725332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 661/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:52:51.008519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266b1e6-46b3-48bc-9f4e-effc98edcdd4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:52:51.010058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e266b1e6-46b3-48bc-9f4e-effc98edcdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:51.112069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266b1e6-46b3-48bc-9f4e-effc98edcdd4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:52:51.186270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:52:51.188591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c683c44-8a87-45c1-84a1-24e45d3df85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:52:51.189567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683c44-8a87-45c1-84a1-24e45d3df85f service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:51.190161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683c44-8a87-45c1-84a1-24e45d3df85f service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:51.190786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683c44-8a87-45c1-84a1-24e45d3df85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:51.192961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0c683c44-8a87-45c1-84a1-24e45d3df85f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:51.308800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c683c44-8a87-45c1-84a1-24e45d3df85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:52:51.310182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c683c44-8a87-45c1-84a1-24e45d3df85f service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:52:51.330503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 653/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 04:52:53.780212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d013b04-07eb-484f-9148-c57231cdd332 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:53.780777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d013b04-07eb-484f-9148-c57231cdd332 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:53.780777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d013b04-07eb-484f-9148-c57231cdd332 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:53.782081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 662/1315] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:52:53.788018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de50b-f672-46c5-bc1e-840acb9f152a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:53.788431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de50b-f672-46c5-bc1e-840acb9f152a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:53.788589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de50b-f672-46c5-bc1e-840acb9f152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:53.853929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-830de50b-f672-46c5-bc1e-840acb9f152a None None] MFA Rules not processed for user `6658db19c88f4761aa337219a7f426b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:52:53.855155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-830de50b-f672-46c5-bc1e-840acb9f152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:53.908265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:52:53.952222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 654/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:52:54.238644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d013b04-07eb-484f-9148-c57231cdd332 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:52:54.240371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8d013b04-07eb-484f-9148-c57231cdd332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:54.250887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:52:54.343630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d013b04-07eb-484f-9148-c57231cdd332 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:52:54.416477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa1103-5a74-4689-9173-5cc37c33e545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:52:54.417068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa1103-5a74-4689-9173-5cc37c33e545 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:54.417338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa1103-5a74-4689-9173-5cc37c33e545 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:54.417602 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa1103-5a74-4689-9173-5cc37c33e545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:54.419210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b4fa1103-5a74-4689-9173-5cc37c33e545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:54.480608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:52:54.526726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa1103-5a74-4689-9173-5cc37c33e545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:52:54.528201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa1103-5a74-4689-9173-5cc37c33e545 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:52:54.546267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 663/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:52:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:52:57.234266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2beb-373e-47a6-a185-34abae7b4251 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:57.234847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2beb-373e-47a6-a185-34abae7b4251 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:57.234847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2beb-373e-47a6-a185-34abae7b4251 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:57.236277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 655/1318] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:52:57.241968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e04a-13b2-4b1d-b0e9-fb035bf3af1f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:57.242414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e04a-13b2-4b1d-b0e9-fb035bf3af1f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:57.242512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e04a-13b2-4b1d-b0e9-fb035bf3af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:57.306620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9498e04a-13b2-4b1d-b0e9-fb035bf3af1f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:52:57.307836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9498e04a-13b2-4b1d-b0e9-fb035bf3af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:57.404946 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 664/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:52:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:52:57.690682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a2beb-373e-47a6-a185-34abae7b4251 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:52:57.692354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-067a2beb-373e-47a6-a185-34abae7b4251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:57.792721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a2beb-373e-47a6-a185-34abae7b4251 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:52:57.865081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc89e-4cce-4230-a3b8-e112a84f2001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:52:57.865670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc89e-4cce-4230-a3b8-e112a84f2001 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:52:57.865942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc89e-4cce-4230-a3b8-e112a84f2001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:52:57.866211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc89e-4cce-4230-a3b8-e112a84f2001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:52:57.867818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aa0dc89e-4cce-4230-a3b8-e112a84f2001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:52:57.874513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:52:57.974605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dc89e-4cce-4230-a3b8-e112a84f2001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:52:57.975978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dc89e-4cce-4230-a3b8-e112a84f2001 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:52:57.993932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 656/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:52:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:00.774941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f94982-b14f-40e3-96c8-28017007f909 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:00.775473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f94982-b14f-40e3-96c8-28017007f909 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:00.775473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f94982-b14f-40e3-96c8-28017007f909 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:00.776808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 665/1321] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:00.781922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4657-898c-454a-98a1-b94065a9de59 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:00.782367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4657-898c-454a-98a1-b94065a9de59 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:00.782463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4657-898c-454a-98a1-b94065a9de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:00.852308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-31eb4657-898c-454a-98a1-b94065a9de59 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:00.853544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-31eb4657-898c-454a-98a1-b94065a9de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:00.916640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:00.959318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 657/1322] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:01.256240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b96d-75dd-428d-ad9e-564476cad32c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:01.256539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b96d-75dd-428d-ad9e-564476cad32c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:01.256807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b96d-75dd-428d-ad9e-564476cad32c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:01.258157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 666/1323] 10.222.0.26 () {54 vars in 964 bytes} [Sat Sep 24 04:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:01.264057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f668cc-0c0c-4a81-9dd6-d5e953f35772 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:01.264411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f668cc-0c0c-4a81-9dd6-d5e953f35772 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:01.264689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f668cc-0c0c-4a81-9dd6-d5e953f35772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:01.341366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-18f668cc-0c0c-4a81-9dd6-d5e953f35772 None None] MFA Rules not processed for user `f50dc809ff034866a1f6343e5b32609b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:01.342566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18f668cc-0c0c-4a81-9dd6-d5e953f35772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:01.417710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 658/1324] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Sep 24 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:01.426778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64b96d-75dd-428d-ad9e-564476cad32c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:01.428308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ff64b96d-75dd-428d-ad9e-564476cad32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:01.448032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:01.533414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64b96d-75dd-428d-ad9e-564476cad32c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:01.608015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f86988-1687-4d06-95ea-a75bc730db03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:01.608619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86988-1687-4d06-95ea-a75bc730db03 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:01.608895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86988-1687-4d06-95ea-a75bc730db03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:01.609160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86988-1687-4d06-95ea-a75bc730db03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:01.610758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f9f86988-1687-4d06-95ea-a75bc730db03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:01.690108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:01.728854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86988-1687-4d06-95ea-a75bc730db03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:01.730280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86988-1687-4d06-95ea-a75bc730db03 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:01.749115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 667/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:04.174823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e37f6-03cc-4445-9bcf-0befbc25ea32 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:04.175338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e37f6-03cc-4445-9bcf-0befbc25ea32 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:04.175338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e37f6-03cc-4445-9bcf-0befbc25ea32 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:04.177304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 659/1326] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:04.182539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14a56-3b9a-4876-b54c-9b93925be88a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:04.182972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14a56-3b9a-4876-b54c-9b93925be88a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:04.183116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14a56-3b9a-4876-b54c-9b93925be88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:04.249393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-76d14a56-3b9a-4876-b54c-9b93925be88a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:04.250549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-76d14a56-3b9a-4876-b54c-9b93925be88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:04.347962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 668/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:04.629554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e37f6-03cc-4445-9bcf-0befbc25ea32 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:04.631387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2e4e37f6-03cc-4445-9bcf-0befbc25ea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:04.695350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:04.740776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e37f6-03cc-4445-9bcf-0befbc25ea32 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:04.813236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c94d2d-7e49-4f5e-892a-78a5afd203e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:04.813831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94d2d-7e49-4f5e-892a-78a5afd203e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:04.814105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94d2d-7e49-4f5e-892a-78a5afd203e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:04.814370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94d2d-7e49-4f5e-892a-78a5afd203e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:04.815971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9c94d2d-7e49-4f5e-892a-78a5afd203e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:04.921381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:04.923913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c94d2d-7e49-4f5e-892a-78a5afd203e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:04.926239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c94d2d-7e49-4f5e-892a-78a5afd203e0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:04.944762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 660/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:07.194295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46def2-96d9-428e-821e-094b64cd6477 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:07.194856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46def2-96d9-428e-821e-094b64cd6477 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:07.194856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46def2-96d9-428e-821e-094b64cd6477 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:07.196359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 669/1329] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:07.201615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893f2cc-ed5e-4381-af10-5352c5d317af None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:07.202053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893f2cc-ed5e-4381-af10-5352c5d317af None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:07.202198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893f2cc-ed5e-4381-af10-5352c5d317af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:07.274817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6893f2cc-ed5e-4381-af10-5352c5d317af None None] MFA Rules not processed for user `6658db19c88f4761aa337219a7f426b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:07.276043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6893f2cc-ed5e-4381-af10-5352c5d317af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:07.371379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 661/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:07.662596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46def2-96d9-428e-821e-094b64cd6477 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:07.664227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4c46def2-96d9-428e-821e-094b64cd6477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:07.694837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:07.775275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46def2-96d9-428e-821e-094b64cd6477 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:07.851104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12625425-a75a-4b9b-8158-5a883e338a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:07.851709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12625425-a75a-4b9b-8158-5a883e338a50 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:07.851984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12625425-a75a-4b9b-8158-5a883e338a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:07.852253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12625425-a75a-4b9b-8158-5a883e338a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:07.853852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-12625425-a75a-4b9b-8158-5a883e338a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:07.934303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:07.970909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12625425-a75a-4b9b-8158-5a883e338a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:07.973143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12625425-a75a-4b9b-8158-5a883e338a50 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:07.992045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 670/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:10.531911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224be3-fab4-422e-a36d-09cce8c2ea9b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:10.532892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224be3-fab4-422e-a36d-09cce8c2ea9b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:10.532892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224be3-fab4-422e-a36d-09cce8c2ea9b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:10.534773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 662/1332] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:10.542652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e2daa-6af3-4408-8622-ecb06026eac7 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:10.543111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e2daa-6af3-4408-8622-ecb06026eac7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:10.543233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e2daa-6af3-4408-8622-ecb06026eac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:10.607911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6e5e2daa-6af3-4408-8622-ecb06026eac7 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:10.609111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6e5e2daa-6af3-4408-8622-ecb06026eac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:10.703609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 671/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:10.987043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224be3-fab4-422e-a36d-09cce8c2ea9b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:10.988693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-32224be3-fab4-422e-a36d-09cce8c2ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:11.058116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:11.092405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224be3-fab4-422e-a36d-09cce8c2ea9b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:11.164448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6e3fa-dc1c-4f1a-abea-1d00b5fe28f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:11.165036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e3fa-dc1c-4f1a-abea-1d00b5fe28f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:11.165311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e3fa-dc1c-4f1a-abea-1d00b5fe28f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:11.165578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e3fa-dc1c-4f1a-abea-1d00b5fe28f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:11.167180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-73c6e3fa-dc1c-4f1a-abea-1d00b5fe28f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:11.274371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6e3fa-dc1c-4f1a-abea-1d00b5fe28f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:11.275839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6e3fa-dc1c-4f1a-abea-1d00b5fe28f4 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:11.285516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:11.294138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 663/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:13.476619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb5e8d-80c8-48ae-851a-372abe4dd51f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:13.477168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb5e8d-80c8-48ae-851a-372abe4dd51f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:13.477168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb5e8d-80c8-48ae-851a-372abe4dd51f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:13.478495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 672/1335] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:13.483777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af2c2-4dbb-449c-8217-58fc47200b20 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:13.484162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af2c2-4dbb-449c-8217-58fc47200b20 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:13.484317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af2c2-4dbb-449c-8217-58fc47200b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:13.553473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-255af2c2-4dbb-449c-8217-58fc47200b20 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:13.554671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-255af2c2-4dbb-449c-8217-58fc47200b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:13.648948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 664/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:13.933365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb5e8d-80c8-48ae-851a-372abe4dd51f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:13.934906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-28fb5e8d-80c8-48ae-851a-372abe4dd51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:13.976291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:14.039785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb5e8d-80c8-48ae-851a-372abe4dd51f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:14.111559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bc29c-1de2-4a44-9bb2-e11529e16a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:14.112157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bc29c-1de2-4a44-9bb2-e11529e16a52 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:14.112430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bc29c-1de2-4a44-9bb2-e11529e16a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:14.112699 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bc29c-1de2-4a44-9bb2-e11529e16a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:14.114287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fa0bc29c-1de2-4a44-9bb2-e11529e16a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:14.197067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:14.223276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bc29c-1de2-4a44-9bb2-e11529e16a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:14.224744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bc29c-1de2-4a44-9bb2-e11529e16a52 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:14.242989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 673/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:16.840178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539959f-769b-4d06-8502-93872b563bc2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:16.840775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539959f-769b-4d06-8502-93872b563bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:16.840775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539959f-769b-4d06-8502-93872b563bc2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:16.842036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 665/1338] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:16.847243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14457d-8214-4c13-b1e3-261f2a4280d5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:16.847650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14457d-8214-4c13-b1e3-261f2a4280d5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:16.847838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14457d-8214-4c13-b1e3-261f2a4280d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:16.912583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ee14457d-8214-4c13-b1e3-261f2a4280d5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:16.913715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ee14457d-8214-4c13-b1e3-261f2a4280d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:17.008672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 674/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:17.290658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539959f-769b-4d06-8502-93872b563bc2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:17.292207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f539959f-769b-4d06-8502-93872b563bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:17.369316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:17.397700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539959f-769b-4d06-8502-93872b563bc2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:17.470258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119cafb-f6a8-4220-a658-e37641252ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:17.470867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119cafb-f6a8-4220-a658-e37641252ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:17.471137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119cafb-f6a8-4220-a658-e37641252ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:17.471399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119cafb-f6a8-4220-a658-e37641252ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:17.473794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4119cafb-f6a8-4220-a658-e37641252ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:17.586321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119cafb-f6a8-4220-a658-e37641252ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:17.587720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119cafb-f6a8-4220-a658-e37641252ee2 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:17.606577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 666/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:21.788658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0cc40-b431-46b4-902b-37713602bcbf None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:21.789191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0cc40-b431-46b4-902b-37713602bcbf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:21.789191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0cc40-b431-46b4-902b-37713602bcbf None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:21.790712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 675/1341] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:21.796562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a890312-2404-405d-9d81-4a1d65d3a268 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:21.796970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a890312-2404-405d-9d81-4a1d65d3a268 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:21.797589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a890312-2404-405d-9d81-4a1d65d3a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:21.803289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:21.873327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5a890312-2404-405d-9d81-4a1d65d3a268 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:21.874448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5a890312-2404-405d-9d81-4a1d65d3a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:21.976803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 667/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:22.261449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0cc40-b431-46b4-902b-37713602bcbf None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:22.263030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4fb0cc40-b431-46b4-902b-37713602bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:22.311180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:22.367686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0cc40-b431-46b4-902b-37713602bcbf None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:22.444748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b83924-f737-4f72-ac90-c5dee827b15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:22.445259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83924-f737-4f72-ac90-c5dee827b15e service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:22.445535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83924-f737-4f72-ac90-c5dee827b15e service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:22.445803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83924-f737-4f72-ac90-c5dee827b15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:22.447418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b0b83924-f737-4f72-ac90-c5dee827b15e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:22.542206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:22.558688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b83924-f737-4f72-ac90-c5dee827b15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:22.560150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b83924-f737-4f72-ac90-c5dee827b15e service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:22.579000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 676/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:25.357113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341fdf-2c4f-4492-81f8-ac708b632ce1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:25.357719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341fdf-2c4f-4492-81f8-ac708b632ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:25.357719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341fdf-2c4f-4492-81f8-ac708b632ce1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:25.359028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 668/1344] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:25.364339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85667d7e-ecb5-49c3-a7e1-04f0f19cc1ae None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:25.364767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85667d7e-ecb5-49c3-a7e1-04f0f19cc1ae None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:25.365009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85667d7e-ecb5-49c3-a7e1-04f0f19cc1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:25.430926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-85667d7e-ecb5-49c3-a7e1-04f0f19cc1ae None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:25.432145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-85667d7e-ecb5-49c3-a7e1-04f0f19cc1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:25.527287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 677/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:25.816991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67341fdf-2c4f-4492-81f8-ac708b632ce1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:25.818679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-67341fdf-2c4f-4492-81f8-ac708b632ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:25.910828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:25.928274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67341fdf-2c4f-4492-81f8-ac708b632ce1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:26.007963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10765fd-4dd0-48e2-b058-373741b3e382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:26.008566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10765fd-4dd0-48e2-b058-373741b3e382 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:26.008840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10765fd-4dd0-48e2-b058-373741b3e382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:26.009106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10765fd-4dd0-48e2-b058-373741b3e382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:26.010691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a10765fd-4dd0-48e2-b058-373741b3e382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:26.119396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10765fd-4dd0-48e2-b058-373741b3e382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:26.120828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10765fd-4dd0-48e2-b058-373741b3e382 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:26.140016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 669/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:30.278324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620189a8-3d42-4e41-b1b2-c8a72e49f3d8 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:30.278867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620189a8-3d42-4e41-b1b2-c8a72e49f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:30.279068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620189a8-3d42-4e41-b1b2-c8a72e49f3d8 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:30.281609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 678/1347] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:30.287201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a27ae-19d5-4e9f-b2f6-dd89315197fe None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:30.287201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a27ae-19d5-4e9f-b2f6-dd89315197fe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:30.287201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a27ae-19d5-4e9f-b2f6-dd89315197fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:30.304349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:30.361992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f37a27ae-19d5-4e9f-b2f6-dd89315197fe None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:30.363780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f37a27ae-19d5-4e9f-b2f6-dd89315197fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:30.470660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 670/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:30.756350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620189a8-3d42-4e41-b1b2-c8a72e49f3d8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:30.758136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-620189a8-3d42-4e41-b1b2-c8a72e49f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:30.817000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:30.862650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620189a8-3d42-4e41-b1b2-c8a72e49f3d8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:30.934366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413c832-ef2e-4829-af90-90b8f4c74d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:30.934999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413c832-ef2e-4829-af90-90b8f4c74d6e service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:30.935263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413c832-ef2e-4829-af90-90b8f4c74d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:30.935539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413c832-ef2e-4829-af90-90b8f4c74d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:30.937128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7413c832-ef2e-4829-af90-90b8f4c74d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:31.043265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:31.047028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413c832-ef2e-4829-af90-90b8f4c74d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:31.048469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413c832-ef2e-4829-af90-90b8f4c74d6e service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:31.067252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 679/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:36.100041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ae78-dccc-428e-8c74-bcf0c3d1740a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:36.100936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ae78-dccc-428e-8c74-bcf0c3d1740a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:36.101419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ae78-dccc-428e-8c74-bcf0c3d1740a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:36.104743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 671/1350] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 04:53:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:36.112471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eae835-2fdb-46b4-8816-546fa161d1f3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:36.113785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eae835-2fdb-46b4-8816-546fa161d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:36.114063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eae835-2fdb-46b4-8816-546fa161d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:36.228411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a8eae835-2fdb-46b4-8816-546fa161d1f3 None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:36.229886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a8eae835-2fdb-46b4-8816-546fa161d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:36.373460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 680/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 04:53:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:40.435936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750e4cd-70d7-4d64-ad09-d34b3aff0758 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:40.436924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750e4cd-70d7-4d64-ad09-d34b3aff0758 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:40.437418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750e4cd-70d7-4d64-ad09-d34b3aff0758 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:40.439644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 672/1352] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 04:53:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:40.445360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96775b-f2c4-49c6-b1aa-260b21ce8a9c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:40.445805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96775b-f2c4-49c6-b1aa-260b21ce8a9c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:40.445991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96775b-f2c4-49c6-b1aa-260b21ce8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:40.469462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=59 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:40.505621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:40.531310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1a96775b-f2c4-49c6-b1aa-260b21ce8a9c None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:40.532904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1a96775b-f2c4-49c6-b1aa-260b21ce8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:40.654501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 681/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:42.082018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfad60-22d0-4568-a130-ea4482e1b627 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:42.082564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfad60-22d0-4568-a130-ea4482e1b627 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:42.082564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfad60-22d0-4568-a130-ea4482e1b627 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:42.083935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 673/1354] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 04:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:42.088878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb116df-72e6-4c9b-8818-e2efe61fb0e3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:42.089333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb116df-72e6-4c9b-8818-e2efe61fb0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:42.089532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb116df-72e6-4c9b-8818-e2efe61fb0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:42.166646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ebb116df-72e6-4c9b-8818-e2efe61fb0e3 None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:42.167879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ebb116df-72e6-4c9b-8818-e2efe61fb0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:42.212575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:42.277339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 682/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 04:53:46.036511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206d10-196f-43cb-b1e7-b56f5085b027 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:46.037055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206d10-196f-43cb-b1e7-b56f5085b027 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:46.037055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206d10-196f-43cb-b1e7-b56f5085b027 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:46.038458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 674/1356] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:46.044100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c0c0-c098-4218-bf0a-b309fb44bed9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:46.044574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c0c0-c098-4218-bf0a-b309fb44bed9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:46.044694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c0c0-c098-4218-bf0a-b309fb44bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:46.117202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7256c0c0-c098-4218-bf0a-b309fb44bed9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:46.118421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7256c0c0-c098-4218-bf0a-b309fb44bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:46.247378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 683/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:46.559480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b29-d67b-42d4-ac88-9cfa3788780e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:46.560011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b29-d67b-42d4-ac88-9cfa3788780e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:46.560451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b29-d67b-42d4-ac88-9cfa3788780e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:46.562184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 675/1358] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 24 04:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:46.571263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee15191-8ba5-4ad0-8974-a0a155ecc414 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:46.571574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee15191-8ba5-4ad0-8974-a0a155ecc414 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:46.571812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee15191-8ba5-4ad0-8974-a0a155ecc414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:46.591199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:46.662391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3ee15191-8ba5-4ad0-8974-a0a155ecc414 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:46.663614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3ee15191-8ba5-4ad0-8974-a0a155ecc414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:46.788104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 684/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 24 04:53:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:46.796885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458b29-d67b-42d4-ac88-9cfa3788780e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:46.798435 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-29458b29-d67b-42d4-ac88-9cfa3788780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:46.953024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458b29-d67b-42d4-ac88-9cfa3788780e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:47.029366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:47.075199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457c04d-06aa-4793-91d8-099b025a2cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:47.075894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457c04d-06aa-4793-91d8-099b025a2cd0 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:47.076209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457c04d-06aa-4793-91d8-099b025a2cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:47.076541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457c04d-06aa-4793-91d8-099b025a2cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:47.078188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6457c04d-06aa-4793-91d8-099b025a2cd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:47.179202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457c04d-06aa-4793-91d8-099b025a2cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:47.180881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457c04d-06aa-4793-91d8-099b025a2cd0 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:47.200296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 676/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 04:53:49.605470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a8d3-ddff-45fe-8dbb-87d58c0b3052 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:49.605911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a8d3-ddff-45fe-8dbb-87d58c0b3052 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:49.606244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a8d3-ddff-45fe-8dbb-87d58c0b3052 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:49.607719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 685/1361] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:49.619486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb136abe-7ffd-4716-baf1-c29d0ce235af None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:49.619486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb136abe-7ffd-4716-baf1-c29d0ce235af None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:49.619486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb136abe-7ffd-4716-baf1-c29d0ce235af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:49.695928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cb136abe-7ffd-4716-baf1-c29d0ce235af None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:49.697277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb136abe-7ffd-4716-baf1-c29d0ce235af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:49.736780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:49.800419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 677/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 04:53:50.091168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68a8d3-ddff-45fe-8dbb-87d58c0b3052 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:50.092678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fe68a8d3-ddff-45fe-8dbb-87d58c0b3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:50.160319 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:50.270230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68a8d3-ddff-45fe-8dbb-87d58c0b3052 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:50.402090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbadac6-fc24-4754-823f-fd1494f1c17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:50.402705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadac6-fc24-4754-823f-fd1494f1c17d service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:50.403083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadac6-fc24-4754-823f-fd1494f1c17d service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:50.403361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadac6-fc24-4754-823f-fd1494f1c17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:50.404955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-afbadac6-fc24-4754-823f-fd1494f1c17d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:50.429199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:50.498995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbadac6-fc24-4754-823f-fd1494f1c17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:50.500594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbadac6-fc24-4754-823f-fd1494f1c17d service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:50.519094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 686/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:53.021790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f969-ac71-46ab-a9f4-5d7da681a804 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:53.022370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f969-ac71-46ab-a9f4-5d7da681a804 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:53.022370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f969-ac71-46ab-a9f4-5d7da681a804 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:53.023793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 678/1364] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:53:53.029443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6862-b391-4c02-80e7-7943ab684db6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:53.029933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6862-b391-4c02-80e7-7943ab684db6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:53.030216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6862-b391-4c02-80e7-7943ab684db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:53.104115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5a1e6862-b391-4c02-80e7-7943ab684db6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:53.105555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5a1e6862-b391-4c02-80e7-7943ab684db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:53.206451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:53.219130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 687/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:53.502464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ec89-95c1-4147-829c-62cdc3b508ea None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:53.502788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ec89-95c1-4147-829c-62cdc3b508ea None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:53.503076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ec89-95c1-4147-829c-62cdc3b508ea None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:53.504535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 679/1366] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 24 04:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:53.510514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a87d3-3b55-47e1-8f9c-00e8670f4211 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:53.510912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a87d3-3b55-47e1-8f9c-00e8670f4211 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:53.511253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a87d3-3b55-47e1-8f9c-00e8670f4211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:53.601025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e54a87d3-3b55-47e1-8f9c-00e8670f4211 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:53.602261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e54a87d3-3b55-47e1-8f9c-00e8670f4211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:53.741712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 688/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 24 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 04:53:53.750467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53ec89-95c1-4147-829c-62cdc3b508ea None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:53.752139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7a53ec89-95c1-4147-829c-62cdc3b508ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:53.906798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53ec89-95c1-4147-829c-62cdc3b508ea None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:53.929731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:54.031522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3d4aa-6bb0-45ab-876c-2d963dc51163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:54.032280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3d4aa-6bb0-45ab-876c-2d963dc51163 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:54.032569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3d4aa-6bb0-45ab-876c-2d963dc51163 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:54.032839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3d4aa-6bb0-45ab-876c-2d963dc51163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:54.034431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-99c3d4aa-6bb0-45ab-876c-2d963dc51163 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:54.139209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3d4aa-6bb0-45ab-876c-2d963dc51163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:54.141197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3d4aa-6bb0-45ab-876c-2d963dc51163 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:54.162144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 680/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:54.419067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113b2e-e6de-45a8-813e-fbd0f73ed85f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:54.419620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113b2e-e6de-45a8-813e-fbd0f73ed85f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:54.419620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113b2e-e6de-45a8-813e-fbd0f73ed85f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:54.421056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 689/1369] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:54.427700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5cd0d-4957-4835-9f69-ef8f0c544a08 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:54.428014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5cd0d-4957-4835-9f69-ef8f0c544a08 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:54.428258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5cd0d-4957-4835-9f69-ef8f0c544a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:54.464297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:54.506355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dcc5cd0d-4957-4835-9f69-ef8f0c544a08 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:54.507884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dcc5cd0d-4957-4835-9f69-ef8f0c544a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:54.620258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 681/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:54.954248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc935-f931-4a66-99fb-091f29222f0e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:54.954641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc935-f931-4a66-99fb-091f29222f0e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:54.955064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc935-f931-4a66-99fb-091f29222f0e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:54.956923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 690/1371] 10.222.0.26 () {54 vars in 963 bytes} [Sat Sep 24 04:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:54.962194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c102a-c112-4642-a055-f6a1cdb98fa0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:54.962475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c102a-c112-4642-a055-f6a1cdb98fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:54.962743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c102a-c112-4642-a055-f6a1cdb98fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:55.048856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3e7c102a-c112-4642-a055-f6a1cdb98fa0 None None] MFA Rules not processed for user `ac3f250eacf044f1b760f3b75d4ba33a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:55.050352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3e7c102a-c112-4642-a055-f6a1cdb98fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:55.102184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:55.136553 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 682/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Sep 24 04:53:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 04:53:55.144636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc935-f931-4a66-99fb-091f29222f0e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:55.146409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-34efc935-f931-4a66-99fb-091f29222f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:55.203245 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:55.260732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc935-f931-4a66-99fb-091f29222f0e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:55.341655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e7cd-29ac-41d0-97cb-35608211db55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:55.342262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e7cd-29ac-41d0-97cb-35608211db55 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:55.342537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e7cd-29ac-41d0-97cb-35608211db55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:55.342826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e7cd-29ac-41d0-97cb-35608211db55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:55.344442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9eb9e7cd-29ac-41d0-97cb-35608211db55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:55.460752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:55.476868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e7cd-29ac-41d0-97cb-35608211db55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:55.478209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e7cd-29ac-41d0-97cb-35608211db55 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:55.503413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 691/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:56.465521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e283cd-95be-4cbf-9044-84d8f38661c1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:56.466063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e283cd-95be-4cbf-9044-84d8f38661c1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:56.466063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e283cd-95be-4cbf-9044-84d8f38661c1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:56.467324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 683/1374] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:56.472867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c203-0d67-4504-bb00-be4ac6c3692e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:56.473318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c203-0d67-4504-bb00-be4ac6c3692e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:56.473574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0c203-0d67-4504-bb00-be4ac6c3692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:56.539469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c4c0c203-0d67-4504-bb00-be4ac6c3692e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:56.540682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c4c0c203-0d67-4504-bb00-be4ac6c3692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:56.637853 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 692/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:53:56.928940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e283cd-95be-4cbf-9044-84d8f38661c1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:53:56.930480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-05e283cd-95be-4cbf-9044-84d8f38661c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:57.077643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e283cd-95be-4cbf-9044-84d8f38661c1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:53:57.130382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:57.193447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb09536-0fab-48ef-8aa5-952963517d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:53:57.193979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb09536-0fab-48ef-8aa5-952963517d3b service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:57.194282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb09536-0fab-48ef-8aa5-952963517d3b service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:57.194552 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb09536-0fab-48ef-8aa5-952963517d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:57.196184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6bb09536-0fab-48ef-8aa5-952963517d3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:57.286457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb09536-0fab-48ef-8aa5-952963517d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:53:57.288112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb09536-0fab-48ef-8aa5-952963517d3b service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:53:57.309276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 684/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:53:59.548202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2f83-5a16-49aa-811a-ca938e51599c None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:59.549101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2f83-5a16-49aa-811a-ca938e51599c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:59.549567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2f83-5a16-49aa-811a-ca938e51599c None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:59.551981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 693/1377] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:53:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:53:59.557386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b40d0-1a36-4573-92ed-81befccbeb1f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:53:59.557848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b40d0-1a36-4573-92ed-81befccbeb1f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:53:59.557935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b40d0-1a36-4573-92ed-81befccbeb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:53:59.629002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-694b40d0-1a36-4573-92ed-81befccbeb1f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:53:59.630391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-694b40d0-1a36-4573-92ed-81befccbeb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:53:59.638229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:59.742324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 685/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:00.033799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2f83-5a16-49aa-811a-ca938e51599c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:00.035661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-35cf2f83-5a16-49aa-811a-ca938e51599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:00.107042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:00.204974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2f83-5a16-49aa-811a-ca938e51599c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:00.339001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb142-8de7-4e24-977d-9e47c044ddfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:00.339699 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb142-8de7-4e24-977d-9e47c044ddfc service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:00.340141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb142-8de7-4e24-977d-9e47c044ddfc service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:00.340605 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb142-8de7-4e24-977d-9e47c044ddfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:00.343788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d0ecb142-8de7-4e24-977d-9e47c044ddfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:00.367901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:00.444492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb142-8de7-4e24-977d-9e47c044ddfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:00.446092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb142-8de7-4e24-977d-9e47c044ddfc service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:00.465222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 694/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:02.681525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8e768-b3e6-47e1-9e0d-6dcd6820605b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:02.682102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8e768-b3e6-47e1-9e0d-6dcd6820605b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:02.682102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8e768-b3e6-47e1-9e0d-6dcd6820605b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:02.683597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 686/1380] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:02.688719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc463a-608a-41ba-8442-17f0d8e034a2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:02.689113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc463a-608a-41ba-8442-17f0d8e034a2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:02.689277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc463a-608a-41ba-8442-17f0d8e034a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:02.755942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dabc463a-608a-41ba-8442-17f0d8e034a2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:02.757152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dabc463a-608a-41ba-8442-17f0d8e034a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:02.852385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:02.859442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 695/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:03.150997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8e768-b3e6-47e1-9e0d-6dcd6820605b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:03.152675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-45a8e768-b3e6-47e1-9e0d-6dcd6820605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:03.341929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:03.353494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8e768-b3e6-47e1-9e0d-6dcd6820605b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:03.471427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdff7c-2a6a-4d2f-922d-7340e793565e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:03.472057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdff7c-2a6a-4d2f-922d-7340e793565e service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:03.472375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdff7c-2a6a-4d2f-922d-7340e793565e service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:03.473251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdff7c-2a6a-4d2f-922d-7340e793565e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:03.474942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-38bdff7c-2a6a-4d2f-922d-7340e793565e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:03.571358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdff7c-2a6a-4d2f-922d-7340e793565e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:03.573430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdff7c-2a6a-4d2f-922d-7340e793565e service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:03.587367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:03.598702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 687/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:05.871977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c544-0df1-42c5-937c-f928326997e9 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:05.872514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c544-0df1-42c5-937c-f928326997e9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:05.872637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c544-0df1-42c5-937c-f928326997e9 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:05.873916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 696/1383] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:54:05.880506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a4761-d0d1-4518-8ac0-12674f1ffd69 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:05.880960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a4761-d0d1-4518-8ac0-12674f1ffd69 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:05.881328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a4761-d0d1-4518-8ac0-12674f1ffd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:05.952114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fc8a4761-d0d1-4518-8ac0-12674f1ffd69 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:05.953196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fc8a4761-d0d1-4518-8ac0-12674f1ffd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:06.055021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 688/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:06.347220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65c544-0df1-42c5-937c-f928326997e9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:06.349664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0a65c544-0df1-42c5-937c-f928326997e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:06.514231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65c544-0df1-42c5-937c-f928326997e9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:06.583344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:06.633497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ed81c-fb57-479a-a4d9-a91f3efd106b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:06.634209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed81c-fb57-479a-a4d9-a91f3efd106b service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:06.634482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed81c-fb57-479a-a4d9-a91f3efd106b service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:06.634766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed81c-fb57-479a-a4d9-a91f3efd106b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:06.636416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f04ed81c-fb57-479a-a4d9-a91f3efd106b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:06.746560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ed81c-fb57-479a-a4d9-a91f3efd106b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:06.748202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ed81c-fb57-479a-a4d9-a91f3efd106b service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:06.770140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 697/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:08.964903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf24bf-2744-4455-8730-848804ab4868 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:08.965458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf24bf-2744-4455-8730-848804ab4868 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:08.965458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf24bf-2744-4455-8730-848804ab4868 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:08.966708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 689/1386] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:08.972159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21892735-f4df-483e-a7fd-0d44fb80e028 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:08.972787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21892735-f4df-483e-a7fd-0d44fb80e028 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:08.972948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21892735-f4df-483e-a7fd-0d44fb80e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:09.040770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-21892735-f4df-483e-a7fd-0d44fb80e028 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:09.041992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-21892735-f4df-483e-a7fd-0d44fb80e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:09.076192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:09.141441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 698/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 04:54:09.432405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf24bf-2744-4455-8730-848804ab4868 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:09.433948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8abf24bf-2744-4455-8730-848804ab4868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:09.509347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:09.579262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf24bf-2744-4455-8730-848804ab4868 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:09.698358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602da447-ed47-4ef5-8ddb-3a4c8544c7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:09.698921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602da447-ed47-4ef5-8ddb-3a4c8544c7f0 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:09.699200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602da447-ed47-4ef5-8ddb-3a4c8544c7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:09.699469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602da447-ed47-4ef5-8ddb-3a4c8544c7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:09.701050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-602da447-ed47-4ef5-8ddb-3a4c8544c7f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:09.741440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:09.795639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602da447-ed47-4ef5-8ddb-3a4c8544c7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:09.797217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602da447-ed47-4ef5-8ddb-3a4c8544c7f0 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:09.815790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 690/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 04:54:11.039315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef64c-47e0-41bf-a7bd-aa5b5b17dd36 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:11.039888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef64c-47e0-41bf-a7bd-aa5b5b17dd36 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:11.039888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef64c-47e0-41bf-a7bd-aa5b5b17dd36 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:11.041196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 699/1389] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:11.046364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b810-eb08-4b5c-a607-4dd6d1cf49af None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:11.046822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b810-eb08-4b5c-a607-4dd6d1cf49af None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:11.046948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b810-eb08-4b5c-a607-4dd6d1cf49af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:11.115902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2742b810-eb08-4b5c-a607-4dd6d1cf49af None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:11.117094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2742b810-eb08-4b5c-a607-4dd6d1cf49af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:11.217027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 691/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:11.517491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b117c-e65c-4f2f-a607-cbb56f935efb None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:11.517780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b117c-e65c-4f2f-a607-cbb56f935efb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:11.518055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b117c-e65c-4f2f-a607-cbb56f935efb None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:11.519481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 700/1391] 10.222.0.26 () {54 vars in 962 bytes} [Sat Sep 24 04:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:11.525055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37117de-82a9-49cc-b854-6c92ab9b0732 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:11.525335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37117de-82a9-49cc-b854-6c92ab9b0732 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:11.525602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37117de-82a9-49cc-b854-6c92ab9b0732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:11.541459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:11.603089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f37117de-82a9-49cc-b854-6c92ab9b0732 None None] MFA Rules not processed for user `c0a3fcdfea364647ad88070a96793065`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:11.604294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f37117de-82a9-49cc-b854-6c92ab9b0732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:11.681752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 692/1392] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Sep 24 04:54:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:11.689446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b117c-e65c-4f2f-a607-cbb56f935efb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:11.691787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1e3b117c-e65c-4f2f-a607-cbb56f935efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:11.796672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b117c-e65c-4f2f-a607-cbb56f935efb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:11.857419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:11.873443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:11.874042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:11.874322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:11.874591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:11.876285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:12.017493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:12.019029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:12.034683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ce4c-9d31-44d1-acf8-5ce7f804e44c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:12.035170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ce4c-9d31-44d1-acf8-5ce7f804e44c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:12.035480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ce4c-9d31-44d1-acf8-5ce7f804e44c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:12.036863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 693/1393] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 04:54:12.038661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 701/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:12.042253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff1fe-af0d-45a8-90c4-707803266e0b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:12.042529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff1fe-af0d-45a8-90c4-707803266e0b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:12.042823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff1fe-af0d-45a8-90c4-707803266e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:12.110028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-36aff1fe-af0d-45a8-90c4-707803266e0b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:12.111175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-36aff1fe-af0d-45a8-90c4-707803266e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:12.165549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:12.208381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 694/1395] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:12.505092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:12.506299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:12.605113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:12.615781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57085e-cb41-47eb-b593-0aa7b9e4b462 service glance] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:12.763037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71bf33-b275-4558-be6c-b2b529015fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:12.764172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71bf33-b275-4558-be6c-b2b529015fcf service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:12.764659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71bf33-b275-4558-be6c-b2b529015fcf service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:12.765119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71bf33-b275-4558-be6c-b2b529015fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:12.766984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ac71bf33-b275-4558-be6c-b2b529015fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:12.796226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4d52-4ad1-4a7a-86e3-630eb8f5bd6c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:12.797613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4d52-4ad1-4a7a-86e3-630eb8f5bd6c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:12.797963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4d52-4ad1-4a7a-86e3-630eb8f5bd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:12.870190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-40ce4d52-4ad1-4a7a-86e3-630eb8f5bd6c None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:12.871439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-40ce4d52-4ad1-4a7a-86e3-630eb8f5bd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:12.872887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71bf33-b275-4558-be6c-b2b529015fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:12.874524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71bf33-b275-4558-be6c-b2b529015fcf service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:12.890238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:12.893869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 702/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:12.964884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 695/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:13.011976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e811b-d772-42dd-b747-515520bdece3 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:13.012265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e811b-d772-42dd-b747-515520bdece3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:13.012544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e811b-d772-42dd-b747-515520bdece3 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:13.013948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 703/1398] 10.222.0.26 () {54 vars in 943 bytes} [Sat Sep 24 04:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:13.022220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868f72-1c16-4ef1-9dd0-27afbabd5190 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:13.022506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868f72-1c16-4ef1-9dd0-27afbabd5190 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:13.022812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868f72-1c16-4ef1-9dd0-27afbabd5190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:13.087059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:13.108691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-db868f72-1c16-4ef1-9dd0-27afbabd5190 None None] MFA Rules not processed for user `473bfd2bae82474e81232a3bb364e5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:13.110098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db868f72-1c16-4ef1-9dd0-27afbabd5190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:13.218580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 696/1399] 10.222.0.26 () {58 vars in 1040 bytes} [Sat Sep 24 04:54:13 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:13.228937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e811b-d772-42dd-b747-515520bdece3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:13.230581 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-835e811b-d772-42dd-b747-515520bdece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:13.368322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e811b-d772-42dd-b747-515520bdece3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:13.572164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:13.592086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13818c4c-4411-4e1a-948c-7ed38e6873d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:13.592692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13818c4c-4411-4e1a-948c-7ed38e6873d1 service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:13.592971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13818c4c-4411-4e1a-948c-7ed38e6873d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:13.593238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13818c4c-4411-4e1a-948c-7ed38e6873d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:13.594903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-13818c4c-4411-4e1a-948c-7ed38e6873d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:13.684094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13818c4c-4411-4e1a-948c-7ed38e6873d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:13.685729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13818c4c-4411-4e1a-948c-7ed38e6873d1 service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:13.694109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 704/1400] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 04:54:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 04:54:15.145249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65fd4-e553-4532-a7f6-0919a6141d68 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:15.145801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65fd4-e553-4532-a7f6-0919a6141d68 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:15.145801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65fd4-e553-4532-a7f6-0919a6141d68 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:15.149841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 697/1401] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:54:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:15.152505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01518-08e2-4086-b7b3-92736d952080 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:15.152938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01518-08e2-4086-b7b3-92736d952080 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:15.153081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01518-08e2-4086-b7b3-92736d952080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:15.226986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0ed01518-08e2-4086-b7b3-92736d952080 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:15.228208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0ed01518-08e2-4086-b7b3-92736d952080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:15.325400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:15.372347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 705/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:15.676701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be65fd4-e553-4532-a7f6-0919a6141d68 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:15.678217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1be65fd4-e553-4532-a7f6-0919a6141d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:15.802865 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:15.854068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be65fd4-e553-4532-a7f6-0919a6141d68 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:15.985799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b42529-c7f0-4bd6-8454-ac352540e38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:15.985799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42529-c7f0-4bd6-8454-ac352540e38e service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:15.985799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42529-c7f0-4bd6-8454-ac352540e38e service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:15.986163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42529-c7f0-4bd6-8454-ac352540e38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:15.987559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-67b42529-c7f0-4bd6-8454-ac352540e38e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:16.069555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:16.091775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b42529-c7f0-4bd6-8454-ac352540e38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:16.093818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b42529-c7f0-4bd6-8454-ac352540e38e service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:16.121472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 698/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:18.396721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d6866-117c-4c77-983f-b3cdfa7497be None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:18.397373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d6866-117c-4c77-983f-b3cdfa7497be None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:18.397373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d6866-117c-4c77-983f-b3cdfa7497be None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:18.400326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 706/1404] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:18.404166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef140d-bf06-4751-8743-8313c710cf38 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:18.404618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef140d-bf06-4751-8743-8313c710cf38 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:18.404848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef140d-bf06-4751-8743-8313c710cf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:18.478725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-18ef140d-bf06-4751-8743-8313c710cf38 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:18.479952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18ef140d-bf06-4751-8743-8313c710cf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:18.593639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 699/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 04:54:18.888406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d6866-117c-4c77-983f-b3cdfa7497be None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:18.890107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b15d6866-117c-4c77-983f-b3cdfa7497be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:19.055096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d6866-117c-4c77-983f-b3cdfa7497be None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:19.113782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:19.183680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1946f-9f2d-4656-bc37-2780d1b0c0b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:19.184196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1946f-9f2d-4656-bc37-2780d1b0c0b4 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:19.184607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1946f-9f2d-4656-bc37-2780d1b0c0b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:19.184883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1946f-9f2d-4656-bc37-2780d1b0c0b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:19.186482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-87e1946f-9f2d-4656-bc37-2780d1b0c0b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:19.284204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1946f-9f2d-4656-bc37-2780d1b0c0b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:19.286567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1946f-9f2d-4656-bc37-2780d1b0c0b4 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:19.305307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 707/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:21.541895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c866-8159-49c0-a5a7-a24036437742 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:21.541895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c866-8159-49c0-a5a7-a24036437742 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:21.541895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c866-8159-49c0-a5a7-a24036437742 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:21.549830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9661c-ad86-4014-b32f-36c07c3038a2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:21.549830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9661c-ad86-4014-b32f-36c07c3038a2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:21.552049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9661c-ad86-4014-b32f-36c07c3038a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:21.555906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 700/1407] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:54:21 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:21.661632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-95a9661c-ad86-4014-b32f-36c07c3038a2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:21.662889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-95a9661c-ad86-4014-b32f-36c07c3038a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:21.678561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:21.766455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 708/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:22.057777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36c866-8159-49c0-a5a7-a24036437742 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:22.059329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b36c866-8159-49c0-a5a7-a24036437742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:22.114539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:22.223815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36c866-8159-49c0-a5a7-a24036437742 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:22.352873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6efd-7098-4e09-8506-f7a66f02b2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:22.355561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6efd-7098-4e09-8506-f7a66f02b2e4 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:22.355844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6efd-7098-4e09-8506-f7a66f02b2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:22.356124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6efd-7098-4e09-8506-f7a66f02b2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:22.357781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-47de6efd-7098-4e09-8506-f7a66f02b2e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:22.369404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:22.459235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6efd-7098-4e09-8506-f7a66f02b2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:22.460877 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6efd-7098-4e09-8506-f7a66f02b2e4 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:22.479746 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 701/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:31.764532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=37 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:32.476955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=41 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:36.736369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d72a-f1ea-4537-89a6-e3ce9e6ce775 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:36.737111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d72a-f1ea-4537-89a6-e3ce9e6ce775 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:36.737111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d72a-f1ea-4537-89a6-e3ce9e6ce775 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:36.738465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 709/1410] 10.222.0.26 () {54 vars in 918 bytes} [Sat Sep 24 04:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:36.743900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309de22-9f79-4ead-8d20-f890db6b8425 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:36.744305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309de22-9f79-4ead-8d20-f890db6b8425 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:36.744442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309de22-9f79-4ead-8d20-f890db6b8425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:36.819261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9309de22-9f79-4ead-8d20-f890db6b8425 None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:36.820448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9309de22-9f79-4ead-8d20-f890db6b8425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:36.927837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 702/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Sep 24 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:36.943500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303c59f-b476-442f-b0f8-0ac4694dc661 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:36.943786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303c59f-b476-442f-b0f8-0ac4694dc661 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:36.944060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303c59f-b476-442f-b0f8-0ac4694dc661 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:36.945418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 710/1412] 10.222.0.26 () {54 vars in 918 bytes} [Sat Sep 24 04:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:36.950604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf634d-46f0-40c6-8333-df9e0f4ac69b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:36.950923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf634d-46f0-40c6-8333-df9e0f4ac69b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:36.951201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf634d-46f0-40c6-8333-df9e0f4ac69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:37.023826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:37.026883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4faf634d-46f0-40c6-8333-df9e0f4ac69b None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:37.028616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4faf634d-46f0-40c6-8333-df9e0f4ac69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:37.143782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 703/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Sep 24 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:39.706744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4922-133e-48ba-8a08-0c8d8d33b2c6 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:39.707312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4922-133e-48ba-8a08-0c8d8d33b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:39.707312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4922-133e-48ba-8a08-0c8d8d33b2c6 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:39.708673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:39.713794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c341743-87e9-4259-8b0e-50a3a34ffa99 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:39.714196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c341743-87e9-4259-8b0e-50a3a34ffa99 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:39.714335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c341743-87e9-4259-8b0e-50a3a34ffa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:39.783620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1c341743-87e9-4259-8b0e-50a3a34ffa99 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:39.784887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1c341743-87e9-4259-8b0e-50a3a34ffa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:39.848031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:39.890845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:40.180515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef4922-133e-48ba-8a08-0c8d8d33b2c6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:40.182086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7bef4922-133e-48ba-8a08-0c8d8d33b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:40.326092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef4922-133e-48ba-8a08-0c8d8d33b2c6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:40.397107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:40.437150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e1c65-b0b7-4d5f-a0d1-763c11fda9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:40.437673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e1c65-b0b7-4d5f-a0d1-763c11fda9c9 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:40.437943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e1c65-b0b7-4d5f-a0d1-763c11fda9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:40.438209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e1c65-b0b7-4d5f-a0d1-763c11fda9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:40.439964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2b0e1c65-b0b7-4d5f-a0d1-763c11fda9c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:40.527721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e1c65-b0b7-4d5f-a0d1-763c11fda9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:40.529289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e1c65-b0b7-4d5f-a0d1-763c11fda9c9 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:40.547317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 712/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:41.702169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561af6-3fab-4c82-9119-40f7af1c27ae None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:41.702689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561af6-3fab-4c82-9119-40f7af1c27ae None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:41.702689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561af6-3fab-4c82-9119-40f7af1c27ae None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:41.704067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:41.710692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311479-46b2-4cae-8489-68f63bf2115b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:41.711183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311479-46b2-4cae-8489-68f63bf2115b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:41.711308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311479-46b2-4cae-8489-68f63bf2115b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:41.786899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bc311479-46b2-4cae-8489-68f63bf2115b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:41.788115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bc311479-46b2-4cae-8489-68f63bf2115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:41.815317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:41.886155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:42.037259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c561af6-3fab-4c82-9119-40f7af1c27ae None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:42.038833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c561af6-3fab-4c82-9119-40f7af1c27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:42.184027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c561af6-3fab-4c82-9119-40f7af1c27ae None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:42.224601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:42.297459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9fd1c-f2ec-425f-8e0c-88e9a549e891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:42.297984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9fd1c-f2ec-425f-8e0c-88e9a549e891 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:42.298255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9fd1c-f2ec-425f-8e0c-88e9a549e891 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:42.298523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9fd1c-f2ec-425f-8e0c-88e9a549e891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:42.300467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-62a9fd1c-f2ec-425f-8e0c-88e9a549e891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:42.388190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9fd1c-f2ec-425f-8e0c-88e9a549e891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:42.389768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9fd1c-f2ec-425f-8e0c-88e9a549e891 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:42.407751 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 706/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:43.542596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7e53-c1b2-4951-9c75-fc13bccb6d21 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:43.543082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7e53-c1b2-4951-9c75-fc13bccb6d21 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:43.543193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7e53-c1b2-4951-9c75-fc13bccb6d21 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:43.544510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:43.551503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814535-18b5-4500-8cf5-fbf4d3cedc06 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:43.551968 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814535-18b5-4500-8cf5-fbf4d3cedc06 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:43.552085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814535-18b5-4500-8cf5-fbf4d3cedc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:43.606325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:43.628379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a7814535-18b5-4500-8cf5-fbf4d3cedc06 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:43.629731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a7814535-18b5-4500-8cf5-fbf4d3cedc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:43.730878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:43.888621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff7e53-c1b2-4951-9c75-fc13bccb6d21 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:43.890129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-43ff7e53-c1b2-4951-9c75-fc13bccb6d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:44.035349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff7e53-c1b2-4951-9c75-fc13bccb6d21 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:44.047020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:44.149030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1ded9-b363-4bdd-9725-c5a39a9f36e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:44.149624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1ded9-b363-4bdd-9725-c5a39a9f36e9 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:44.149899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1ded9-b363-4bdd-9725-c5a39a9f36e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:44.150167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1ded9-b363-4bdd-9725-c5a39a9f36e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:44.151788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-99d1ded9-b363-4bdd-9725-c5a39a9f36e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:44.238331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1ded9-b363-4bdd-9725-c5a39a9f36e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:44.239926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1ded9-b363-4bdd-9725-c5a39a9f36e9 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:44.259329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 715/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:45.373205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e74c32-8485-42ec-866a-8b1faff6e149 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:45.373781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e74c32-8485-42ec-866a-8b1faff6e149 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:45.373781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e74c32-8485-42ec-866a-8b1faff6e149 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:45.375218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:45.382289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d37fa-7706-43cf-82a0-680bec01f78f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:45.383041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d37fa-7706-43cf-82a0-680bec01f78f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:45.383150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d37fa-7706-43cf-82a0-680bec01f78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:45.402969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:45.458925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2e6d37fa-7706-43cf-82a0-680bec01f78f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:45.460126 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2e6d37fa-7706-43cf-82a0-680bec01f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:45.556538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:45.707486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e74c32-8485-42ec-866a-8b1faff6e149 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:45.708997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-37e74c32-8485-42ec-866a-8b1faff6e149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:45.820908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:45.868130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e74c32-8485-42ec-866a-8b1faff6e149 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:46.002666 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459214fa-6f0b-4f2f-b91c-96b0178d5a41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:46.003300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459214fa-6f0b-4f2f-b91c-96b0178d5a41 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:46.003570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459214fa-6f0b-4f2f-b91c-96b0178d5a41 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:46.003969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459214fa-6f0b-4f2f-b91c-96b0178d5a41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:46.008203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-459214fa-6f0b-4f2f-b91c-96b0178d5a41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:46.096233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:46.112752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459214fa-6f0b-4f2f-b91c-96b0178d5a41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:46.114560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459214fa-6f0b-4f2f-b91c-96b0178d5a41 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:46.135180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 709/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:47.293139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc198df-c3bb-454c-94b4-916ff886e6b8 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:47.293721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc198df-c3bb-454c-94b4-916ff886e6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:47.293721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc198df-c3bb-454c-94b4-916ff886e6b8 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:47.295063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:47.301471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1390cb8-3f09-4e91-bc1e-5a1d39563536 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:47.303219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1390cb8-3f09-4e91-bc1e-5a1d39563536 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:47.303219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1390cb8-3f09-4e91-bc1e-5a1d39563536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:47.382075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b1390cb8-3f09-4e91-bc1e-5a1d39563536 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:47.383498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b1390cb8-3f09-4e91-bc1e-5a1d39563536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:47.477992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:47.629115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc198df-c3bb-454c-94b4-916ff886e6b8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:47.630643 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ddc198df-c3bb-454c-94b4-916ff886e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:47.716388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:47.778360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc198df-c3bb-454c-94b4-916ff886e6b8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:47.890856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eeac7-6360-4ee4-ae69-8c904b4f8a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:47.891508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eeac7-6360-4ee4-ae69-8c904b4f8a85 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:47.891779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eeac7-6360-4ee4-ae69-8c904b4f8a85 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:47.892040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eeac7-6360-4ee4-ae69-8c904b4f8a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:47.894013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-407eeac7-6360-4ee4-ae69-8c904b4f8a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:47.958036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:48.001083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407eeac7-6360-4ee4-ae69-8c904b4f8a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:48.003299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407eeac7-6360-4ee4-ae69-8c904b4f8a85 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:48.021837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 718/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:49.103358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2a78-1b34-4d27-949c-253a054b6c5f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:49.103933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2a78-1b34-4d27-949c-253a054b6c5f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:49.103933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2a78-1b34-4d27-949c-253a054b6c5f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:49.105315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:49.112142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883963-4af6-443e-a081-3430a9999dd2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:49.112593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883963-4af6-443e-a081-3430a9999dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:49.112716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883963-4af6-443e-a081-3430a9999dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:49.188359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-47883963-4af6-443e-a081-3430a9999dd2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:49.190193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-47883963-4af6-443e-a081-3430a9999dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:49.284332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:49.434057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd2a78-1b34-4d27-949c-253a054b6c5f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:49.435528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-64cd2a78-1b34-4d27-949c-253a054b6c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:49.484216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:49.581568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd2a78-1b34-4d27-949c-253a054b6c5f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:49.694050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc1539-0fd4-459b-9e0e-4526cb3c0f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:49.694579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1539-0fd4-459b-9e0e-4526cb3c0f8f service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:49.694886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1539-0fd4-459b-9e0e-4526cb3c0f8f service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:49.695157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1539-0fd4-459b-9e0e-4526cb3c0f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:49.696732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e5dc1539-0fd4-459b-9e0e-4526cb3c0f8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:49.703609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:49.785783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc1539-0fd4-459b-9e0e-4526cb3c0f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:49.787404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc1539-0fd4-459b-9e0e-4526cb3c0f8f service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:49.805589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 712/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:50.871501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05111e-4e02-484a-b245-77ed3130eba3 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:50.872091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05111e-4e02-484a-b245-77ed3130eba3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:50.872091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05111e-4e02-484a-b245-77ed3130eba3 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:50.873390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:50.880357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d81c-3639-4042-985d-112be4dfa183 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:50.880804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d81c-3639-4042-985d-112be4dfa183 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:50.880900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d81c-3639-4042-985d-112be4dfa183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:50.956720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-78b3d81c-3639-4042-985d-112be4dfa183 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:50.957850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-78b3d81c-3639-4042-985d-112be4dfa183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:51.024560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:51.053266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:51.202701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05111e-4e02-484a-b245-77ed3130eba3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:51.204215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1f05111e-4e02-484a-b245-77ed3130eba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:51.221497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:51.346844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05111e-4e02-484a-b245-77ed3130eba3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:51.431657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:51.457140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8763-2342-4941-aee1-394f0c1f07fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:51.457737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8763-2342-4941-aee1-394f0c1f07fa service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:51.458010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8763-2342-4941-aee1-394f0c1f07fa service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:51.458279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8763-2342-4941-aee1-394f0c1f07fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:51.459899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-accc8763-2342-4941-aee1-394f0c1f07fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:51.546697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8763-2342-4941-aee1-394f0c1f07fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:51.548920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8763-2342-4941-aee1-394f0c1f07fa service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:51.566477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 721/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:52.622233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b150f-e95c-4312-b05f-85e4593082ed None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:52.622835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b150f-e95c-4312-b05f-85e4593082ed None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:52.622835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b150f-e95c-4312-b05f-85e4593082ed None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:52.624172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:52.631211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff668a-5a26-40df-a164-d5032f8ab020 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:52.631698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff668a-5a26-40df-a164-d5032f8ab020 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:52.631795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff668a-5a26-40df-a164-d5032f8ab020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:52.709273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ffff668a-5a26-40df-a164-d5032f8ab020 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:52.710491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ffff668a-5a26-40df-a164-d5032f8ab020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:52.751240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:52.806775 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:52.956602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b150f-e95c-4312-b05f-85e4593082ed None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:52.958069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f58b150f-e95c-4312-b05f-85e4593082ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:53.102662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b150f-e95c-4312-b05f-85e4593082ed None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:53.156564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:53.215538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e49f3-5632-4019-9736-b9a3324e69f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:53.216062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e49f3-5632-4019-9736-b9a3324e69f1 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:53.216338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e49f3-5632-4019-9736-b9a3324e69f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:53.216606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e49f3-5632-4019-9736-b9a3324e69f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:53.218258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5b1e49f3-5632-4019-9736-b9a3324e69f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:53.307515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e49f3-5632-4019-9736-b9a3324e69f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:53.309083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e49f3-5632-4019-9736-b9a3324e69f1 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:53.326386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 715/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:54.380831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bd7d-5255-4984-95b7-df91713b37fc None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:54.381412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bd7d-5255-4984-95b7-df91713b37fc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:54.381412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bd7d-5255-4984-95b7-df91713b37fc None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:54.383006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:54.389307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9e3b9-162b-47db-99b7-0639476df90f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:54.389741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9e3b9-162b-47db-99b7-0639476df90f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:54.389843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9e3b9-162b-47db-99b7-0639476df90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:54.464331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a5e9e3b9-162b-47db-99b7-0639476df90f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:54.465544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a5e9e3b9-162b-47db-99b7-0639476df90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:54.467567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:54.561460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:54.712444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617bd7d-5255-4984-95b7-df91713b37fc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:54.713987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a617bd7d-5255-4984-95b7-df91713b37fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:54.858053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617bd7d-5255-4984-95b7-df91713b37fc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:54.884340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:54.970699 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887a9c-5cbf-45be-9000-de94a7cf2ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:54.971502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887a9c-5cbf-45be-9000-de94a7cf2ba8 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:54.971777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887a9c-5cbf-45be-9000-de94a7cf2ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:54.972039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887a9c-5cbf-45be-9000-de94a7cf2ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:54.973639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4e887a9c-5cbf-45be-9000-de94a7cf2ba8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:55.059973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887a9c-5cbf-45be-9000-de94a7cf2ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:55.061551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887a9c-5cbf-45be-9000-de94a7cf2ba8 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:55.079782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 724/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:57.139686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c254db-7402-477f-bf78-4a832313a639 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:57.140273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c254db-7402-477f-bf78-4a832313a639 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:57.140273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c254db-7402-477f-bf78-4a832313a639 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:57.141604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:54:57.147291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322208-80df-457d-ba4d-107bf0011842 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:57.147717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322208-80df-457d-ba4d-107bf0011842 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:57.147812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322208-80df-457d-ba4d-107bf0011842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:57.188082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:57.214525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-95322208-80df-457d-ba4d-107bf0011842 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:54:57.215765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-95322208-80df-457d-ba4d-107bf0011842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:57.310100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:54:57.599280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c254db-7402-477f-bf78-4a832313a639 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:54:57.600806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-08c254db-7402-477f-bf78-4a832313a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:57.709397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c254db-7402-477f-bf78-4a832313a639 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:54:57.741256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:57.783867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36501d80-8cc6-484e-9f19-69a38966b14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:54:57.784462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36501d80-8cc6-484e-9f19-69a38966b14a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:54:57.784734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36501d80-8cc6-484e-9f19-69a38966b14a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:54:57.785000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36501d80-8cc6-484e-9f19-69a38966b14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:54:57.786575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-36501d80-8cc6-484e-9f19-69a38966b14a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:54:57.895232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36501d80-8cc6-484e-9f19-69a38966b14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:54:57.896566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36501d80-8cc6-484e-9f19-69a38966b14a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:54:57.913984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 718/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:00.186671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799adf0-c9e0-411e-b301-ecba653c8f00 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:00.187250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799adf0-c9e0-411e-b301-ecba653c8f00 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:00.187250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799adf0-c9e0-411e-b301-ecba653c8f00 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:00.188627 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:00.193762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8748-7904-48b7-8656-64abeb5a2f9f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:00.194186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8748-7904-48b7-8656-64abeb5a2f9f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:00.194355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8748-7904-48b7-8656-64abeb5a2f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:00.260147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-054d8748-7904-48b7-8656-64abeb5a2f9f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:00.261373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-054d8748-7904-48b7-8656-64abeb5a2f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:00.274388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:00.357473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:00.642324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799adf0-c9e0-411e-b301-ecba653c8f00 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:00.643874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3799adf0-c9e0-411e-b301-ecba653c8f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:00.746634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799adf0-c9e0-411e-b301-ecba653c8f00 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:00.759974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:00.822383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8514c7-8df7-46b9-86e7-b9dc2ff3530d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:00.823011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8514c7-8df7-46b9-86e7-b9dc2ff3530d service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:00.823286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8514c7-8df7-46b9-86e7-b9dc2ff3530d service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:00.823549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8514c7-8df7-46b9-86e7-b9dc2ff3530d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:00.825139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cc8514c7-8df7-46b9-86e7-b9dc2ff3530d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:00.933121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8514c7-8df7-46b9-86e7-b9dc2ff3530d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:00.934469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8514c7-8df7-46b9-86e7-b9dc2ff3530d service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:00.953074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 727/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:03.411225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61731-1738-4808-99da-0a44d78e5bb5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:03.411808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61731-1738-4808-99da-0a44d78e5bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:03.411808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61731-1738-4808-99da-0a44d78e5bb5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:03.413098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:03.418341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae36451-0b5c-41d2-a220-08fcd0c8063e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:03.418816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae36451-0b5c-41d2-a220-08fcd0c8063e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:03.418912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae36451-0b5c-41d2-a220-08fcd0c8063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:03.466841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:03.485885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dae36451-0b5c-41d2-a220-08fcd0c8063e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:03.487144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dae36451-0b5c-41d2-a220-08fcd0c8063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:03.582025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:03.871827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f61731-1738-4808-99da-0a44d78e5bb5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:03.873335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b7f61731-1738-4808-99da-0a44d78e5bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:03.976305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f61731-1738-4808-99da-0a44d78e5bb5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:04.015516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:04.050489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf1b9-cd61-4fd5-9bbf-5209fb64afcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:04.051145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf1b9-cd61-4fd5-9bbf-5209fb64afcf service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:04.051421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf1b9-cd61-4fd5-9bbf-5209fb64afcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:04.051689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf1b9-cd61-4fd5-9bbf-5209fb64afcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:04.053266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e56cf1b9-cd61-4fd5-9bbf-5209fb64afcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:04.161460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cf1b9-cd61-4fd5-9bbf-5209fb64afcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:04.162828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cf1b9-cd61-4fd5-9bbf-5209fb64afcf service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:04.180393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 721/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:06.452390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca3945-17e7-4686-8283-2d69803d0b19 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:06.452960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca3945-17e7-4686-8283-2d69803d0b19 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:06.452960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca3945-17e7-4686-8283-2d69803d0b19 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:06.454596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:06.459833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2dec7-79e1-4a39-b0d8-9feacb4996e3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:06.460250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2dec7-79e1-4a39-b0d8-9feacb4996e3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:06.460382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2dec7-79e1-4a39-b0d8-9feacb4996e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:06.525343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-acc2dec7-79e1-4a39-b0d8-9feacb4996e3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:06.526463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-acc2dec7-79e1-4a39-b0d8-9feacb4996e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:06.547129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:06.622941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:06.918504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca3945-17e7-4686-8283-2d69803d0b19 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:06.920053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cdca3945-17e7-4686-8283-2d69803d0b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:07.022261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca3945-17e7-4686-8283-2d69803d0b19 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:07.042765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:07.095317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59239028-d222-412d-9154-015c27f026b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:07.095910 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59239028-d222-412d-9154-015c27f026b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:07.096184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59239028-d222-412d-9154-015c27f026b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:07.096449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59239028-d222-412d-9154-015c27f026b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:07.098033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-59239028-d222-412d-9154-015c27f026b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:07.203944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59239028-d222-412d-9154-015c27f026b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:07.205421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59239028-d222-412d-9154-015c27f026b8 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:07.223409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 730/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:09.434273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3fa6-135a-417d-838f-5a5b588f36d7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:09.434890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3fa6-135a-417d-838f-5a5b588f36d7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:09.434890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3fa6-135a-417d-838f-5a5b588f36d7 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:09.436200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:09.442198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021ced9-b8e0-4253-9f45-e36bc8399067 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:09.442614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021ced9-b8e0-4253-9f45-e36bc8399067 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:09.442877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021ced9-b8e0-4253-9f45-e36bc8399067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:09.506230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:09.509544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a021ced9-b8e0-4253-9f45-e36bc8399067 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:09.511177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a021ced9-b8e0-4253-9f45-e36bc8399067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:09.606448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:09.896642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3fa6-135a-417d-838f-5a5b588f36d7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:09.898235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-113a3fa6-135a-417d-838f-5a5b588f36d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:09.999555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3fa6-135a-417d-838f-5a5b588f36d7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:10.049202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:10.073042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5408f64-7047-4ee7-9d90-1ff58a62b2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:10.073630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5408f64-7047-4ee7-9d90-1ff58a62b2ed service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:10.073906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5408f64-7047-4ee7-9d90-1ff58a62b2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:10.074171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5408f64-7047-4ee7-9d90-1ff58a62b2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:10.075765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5408f64-7047-4ee7-9d90-1ff58a62b2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:10.183347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5408f64-7047-4ee7-9d90-1ff58a62b2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:10.184688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5408f64-7047-4ee7-9d90-1ff58a62b2ed service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:10.202694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 724/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:12.428068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688cd50-4282-43c7-9850-cd25c666b8ae None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:12.428632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688cd50-4282-43c7-9850-cd25c666b8ae None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:12.428632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688cd50-4282-43c7-9850-cd25c666b8ae None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:12.429963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:12.435353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6f419-f015-4c54-be36-b2476e1a298f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:12.435792 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6f419-f015-4c54-be36-b2476e1a298f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:12.435892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6f419-f015-4c54-be36-b2476e1a298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:12.502463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e1d6f419-f015-4c54-be36-b2476e1a298f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:12.503692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e1d6f419-f015-4c54-be36-b2476e1a298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:12.533121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:12.600733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 04:55:12.886008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688cd50-4282-43c7-9850-cd25c666b8ae None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:12.887607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8688cd50-4282-43c7-9850-cd25c666b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:12.989424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688cd50-4282-43c7-9850-cd25c666b8ae None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:13.018450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:13.062986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39c624-35f6-4705-a41a-10be892f4163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:13.063584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39c624-35f6-4705-a41a-10be892f4163 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:13.063865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39c624-35f6-4705-a41a-10be892f4163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:13.064134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39c624-35f6-4705-a41a-10be892f4163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:13.065711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4a39c624-35f6-4705-a41a-10be892f4163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:13.172559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39c624-35f6-4705-a41a-10be892f4163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:13.173912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39c624-35f6-4705-a41a-10be892f4163 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:13.191638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 733/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:15.405775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb09af-f119-4b48-8015-8a65c8b30330 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:15.406407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb09af-f119-4b48-8015-8a65c8b30330 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:15.406407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb09af-f119-4b48-8015-8a65c8b30330 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:15.407686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:15.413482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347a10-353c-4c88-b6a9-323942ac430a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:15.413897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347a10-353c-4c88-b6a9-323942ac430a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:15.414015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347a10-353c-4c88-b6a9-323942ac430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:15.479436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a4347a10-353c-4c88-b6a9-323942ac430a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:15.480631 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a4347a10-353c-4c88-b6a9-323942ac430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:15.488778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:15.575935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:15.864343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb09af-f119-4b48-8015-8a65c8b30330 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:15.865922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5ffb09af-f119-4b48-8015-8a65c8b30330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:15.969292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb09af-f119-4b48-8015-8a65c8b30330 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:16.024936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:16.043098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165f52-e955-422c-b13b-15e9c7626c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:16.043695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165f52-e955-422c-b13b-15e9c7626c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:16.043970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165f52-e955-422c-b13b-15e9c7626c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:16.044236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165f52-e955-422c-b13b-15e9c7626c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:16.045859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-05165f52-e955-422c-b13b-15e9c7626c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:16.158416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165f52-e955-422c-b13b-15e9c7626c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:16.159913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165f52-e955-422c-b13b-15e9c7626c42 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:16.178028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 727/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:18.376971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb265fe-4c67-4fd7-84fb-58a23a74c1bc None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:18.377586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb265fe-4c67-4fd7-84fb-58a23a74c1bc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:18.377586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb265fe-4c67-4fd7-84fb-58a23a74c1bc None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:18.379161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:18.384730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4d0e0-46b7-4702-af32-3459881ef69c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:18.385172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4d0e0-46b7-4702-af32-3459881ef69c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:18.385172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4d0e0-46b7-4702-af32-3459881ef69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:18.573984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8bb4d0e0-46b7-4702-af32-3459881ef69c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:18.575232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8bb4d0e0-46b7-4702-af32-3459881ef69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:18.613084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:18.671269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:18.957755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb265fe-4c67-4fd7-84fb-58a23a74c1bc None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:18.959344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bdb265fe-4c67-4fd7-84fb-58a23a74c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:19.060900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb265fe-4c67-4fd7-84fb-58a23a74c1bc None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:19.098134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:19.133852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33026850-b84d-46ff-bd57-e0c4bc2aa20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:19.134449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33026850-b84d-46ff-bd57-e0c4bc2aa20e service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:19.134727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33026850-b84d-46ff-bd57-e0c4bc2aa20e service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:19.135027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33026850-b84d-46ff-bd57-e0c4bc2aa20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:19.136626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-33026850-b84d-46ff-bd57-e0c4bc2aa20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:19.243323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33026850-b84d-46ff-bd57-e0c4bc2aa20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:19.244667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33026850-b84d-46ff-bd57-e0c4bc2aa20e service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:19.262304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 736/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:21.469246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04a26-a8f4-407c-81f1-53014195a58a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:21.469851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04a26-a8f4-407c-81f1-53014195a58a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:21.469851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04a26-a8f4-407c-81f1-53014195a58a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:21.471185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:21.476395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca97c9-411b-4e89-93c9-4fc58a8848d8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:21.476803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca97c9-411b-4e89-93c9-4fc58a8848d8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:21.476938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca97c9-411b-4e89-93c9-4fc58a8848d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:21.542312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-03ca97c9-411b-4e89-93c9-4fc58a8848d8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:21.543551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-03ca97c9-411b-4e89-93c9-4fc58a8848d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:21.562117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:21.640003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:21.926022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe04a26-a8f4-407c-81f1-53014195a58a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:21.927590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3fe04a26-a8f4-407c-81f1-53014195a58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:22.029862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe04a26-a8f4-407c-81f1-53014195a58a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:22.096623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:22.103782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955503-12c7-4033-9994-49d9093e31aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:22.104374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955503-12c7-4033-9994-49d9093e31aa service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:22.104668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955503-12c7-4033-9994-49d9093e31aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:22.104927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955503-12c7-4033-9994-49d9093e31aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:22.106509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0a955503-12c7-4033-9994-49d9093e31aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:22.214147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955503-12c7-4033-9994-49d9093e31aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:22.215505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955503-12c7-4033-9994-49d9093e31aa service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:22.234090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 730/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:24.394076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fcb1b-8b00-48a9-941d-33f34b905f42 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:24.394661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fcb1b-8b00-48a9-941d-33f34b905f42 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:24.394661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fcb1b-8b00-48a9-941d-33f34b905f42 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:24.395979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:24.401398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76aa89-594f-42c4-ab60-8b0fd5335a45 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:24.401832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76aa89-594f-42c4-ab60-8b0fd5335a45 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:24.401940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76aa89-594f-42c4-ab60-8b0fd5335a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:24.466906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ad76aa89-594f-42c4-ab60-8b0fd5335a45 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:24.468575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ad76aa89-594f-42c4-ab60-8b0fd5335a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:24.516446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:24.564489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 04:55:24.851114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fcb1b-8b00-48a9-941d-33f34b905f42 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:24.852638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3d8fcb1b-8b00-48a9-941d-33f34b905f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:24.954831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fcb1b-8b00-48a9-941d-33f34b905f42 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:25.002892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:25.028265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fe2f9-a493-40cf-9804-d9daead93200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:25.028864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe2f9-a493-40cf-9804-d9daead93200 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:25.029138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe2f9-a493-40cf-9804-d9daead93200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:25.029406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe2f9-a493-40cf-9804-d9daead93200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:25.031285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-331fe2f9-a493-40cf-9804-d9daead93200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:25.137078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fe2f9-a493-40cf-9804-d9daead93200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:25.138420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fe2f9-a493-40cf-9804-d9daead93200 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:25.156128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 739/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:34.563004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=22 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:35.153793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=66 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:45.053369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989563b-219d-48f1-970e-54103981f75c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:45.053938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989563b-219d-48f1-970e-54103981f75c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:45.053938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989563b-219d-48f1-970e-54103981f75c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:45.055296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 732/1471] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:45.060488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae99b1-46a8-45a0-b6aa-4ce1ef1ed477 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:45.061506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae99b1-46a8-45a0-b6aa-4ce1ef1ed477 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:45.061696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae99b1-46a8-45a0-b6aa-4ce1ef1ed477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:45.127121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-27ae99b1-46a8-45a0-b6aa-4ce1ef1ed477 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:45.128335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-27ae99b1-46a8-45a0-b6aa-4ce1ef1ed477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:45.222991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 740/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:45.521387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447ba78-0df8-4f66-a334-93176388b061 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:45.521670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447ba78-0df8-4f66-a334-93176388b061 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:45.521939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447ba78-0df8-4f66-a334-93176388b061 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:45.523297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 733/1473] 10.222.0.26 () {54 vars in 962 bytes} [Sat Sep 24 04:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:45.528185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0ab7-7c1a-4248-8836-b853e5b22c1e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:45.528490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0ab7-7c1a-4248-8836-b853e5b22c1e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:45.528758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0ab7-7c1a-4248-8836-b853e5b22c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:45.604875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-054f0ab7-7c1a-4248-8836-b853e5b22c1e None None] MFA Rules not processed for user `c0a3fcdfea364647ad88070a96793065`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:45.606078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-054f0ab7-7c1a-4248-8836-b853e5b22c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:45.626915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:45.683063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 741/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Sep 24 04:55:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:45.690862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447ba78-0df8-4f66-a334-93176388b061 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:45.692400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5447ba78-0df8-4f66-a334-93176388b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:45.794357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447ba78-0df8-4f66-a334-93176388b061 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:45.866763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196c593-75b3-45f2-9c53-8e790c4efbae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:45.867385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c593-75b3-45f2-9c53-8e790c4efbae service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:45.867658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c593-75b3-45f2-9c53-8e790c4efbae service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:45.867926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196c593-75b3-45f2-9c53-8e790c4efbae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:45.869500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6196c593-75b3-45f2-9c53-8e790c4efbae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:45.925334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:45.980837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196c593-75b3-45f2-9c53-8e790c4efbae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:45.982436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196c593-75b3-45f2-9c53-8e790c4efbae service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:46.000703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 734/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 04:55:48.356337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc86c8-2e85-4b23-a06a-ab6c88ea1469 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:48.356879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc86c8-2e85-4b23-a06a-ab6c88ea1469 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:48.356879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc86c8-2e85-4b23-a06a-ab6c88ea1469 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:48.358801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 742/1476] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:48.364131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f54a-8b08-4dc2-86f1-ed27ecb25649 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:48.364596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f54a-8b08-4dc2-86f1-ed27ecb25649 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:48.364701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f54a-8b08-4dc2-86f1-ed27ecb25649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:48.429078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f3d7f54a-8b08-4dc2-86f1-ed27ecb25649 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:48.430272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f3d7f54a-8b08-4dc2-86f1-ed27ecb25649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:48.524856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 735/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:48.804233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc86c8-2e85-4b23-a06a-ab6c88ea1469 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:48.805820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-92bc86c8-2e85-4b23-a06a-ab6c88ea1469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:48.929829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc86c8-2e85-4b23-a06a-ab6c88ea1469 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:48.979392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:49.024457 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7fdf5-7b58-48f9-9563-59ae087dee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:49.025054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7fdf5-7b58-48f9-9563-59ae087dee1b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:49.025330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7fdf5-7b58-48f9-9563-59ae087dee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:49.025598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7fdf5-7b58-48f9-9563-59ae087dee1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:49.026230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7fdf5-7b58-48f9-9563-59ae087dee1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:49.027964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-b9d7fdf5-7b58-48f9-9563-59ae087dee1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:55:49.027964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: warnings.warn(msg) Sep 24 04:55:49.027964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: Sep 24 04:55:49.029111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7fdf5-7b58-48f9-9563-59ae087dee1b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:49.048582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 743/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 24 04:55:48 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 04:55:51.207134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672eba1-3c21-4f84-9374-b42dad0f0d2e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:51.207726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672eba1-3c21-4f84-9374-b42dad0f0d2e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:51.207726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672eba1-3c21-4f84-9374-b42dad0f0d2e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:51.208984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 736/1479] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:51.214147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438a85-8221-4699-a254-b700c5b7355c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:51.214595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438a85-8221-4699-a254-b700c5b7355c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:51.214700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438a85-8221-4699-a254-b700c5b7355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:51.280564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-50438a85-8221-4699-a254-b700c5b7355c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:51.281758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-50438a85-8221-4699-a254-b700c5b7355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:51.380253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 744/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:51.672570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672eba1-3c21-4f84-9374-b42dad0f0d2e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:51.674138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8672eba1-3c21-4f84-9374-b42dad0f0d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:51.683930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:51.818650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672eba1-3c21-4f84-9374-b42dad0f0d2e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:51.901373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:51.934253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b453-0255-403f-892f-e4dcb3e557ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:51.934795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b453-0255-403f-892f-e4dcb3e557ba service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:51.935069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b453-0255-403f-892f-e4dcb3e557ba service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:51.935367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b453-0255-403f-892f-e4dcb3e557ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:51.937004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-48c5b453-0255-403f-892f-e4dcb3e557ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:52.025668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b453-0255-403f-892f-e4dcb3e557ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:52.027239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b453-0255-403f-892f-e4dcb3e557ba service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:52.045083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 737/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:54.370164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6130c-049f-4883-84fd-605133a6ad7b None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:54.370707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6130c-049f-4883-84fd-605133a6ad7b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:54.370707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6130c-049f-4883-84fd-605133a6ad7b None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:54.372063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 745/1482] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:54.377225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018106a-44d9-49e8-833e-ef5f3b968f82 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:54.377630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018106a-44d9-49e8-833e-ef5f3b968f82 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:54.377761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018106a-44d9-49e8-833e-ef5f3b968f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:54.443115 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c018106a-44d9-49e8-833e-ef5f3b968f82 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:54.444315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c018106a-44d9-49e8-833e-ef5f3b968f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:54.490242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:54.540186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 738/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:54.826835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6130c-049f-4883-84fd-605133a6ad7b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:54.828320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9ed6130c-049f-4883-84fd-605133a6ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:54.852096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:54.931781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6130c-049f-4883-84fd-605133a6ad7b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:55.003313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0397cd-6bdd-40c5-aab3-28c7b2c0e165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:55.003906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0397cd-6bdd-40c5-aab3-28c7b2c0e165 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:55.004181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0397cd-6bdd-40c5-aab3-28c7b2c0e165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:55.004447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0397cd-6bdd-40c5-aab3-28c7b2c0e165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:55.006268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cc0397cd-6bdd-40c5-aab3-28c7b2c0e165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:55.079629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:55.113875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0397cd-6bdd-40c5-aab3-28c7b2c0e165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:55.115335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0397cd-6bdd-40c5-aab3-28c7b2c0e165 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:55.133792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 746/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:55:57.336306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7547a6-2279-4d2f-bed4-8faa26ea64da None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:57.336915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7547a6-2279-4d2f-bed4-8faa26ea64da None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:57.336915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7547a6-2279-4d2f-bed4-8faa26ea64da None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:57.338164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 739/1485] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:55:57.343580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85784-5dcd-4899-83ea-6b7cab1ff7b8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:57.343989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85784-5dcd-4899-83ea-6b7cab1ff7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:57.344129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85784-5dcd-4899-83ea-6b7cab1ff7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:57.409559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-79b85784-5dcd-4899-83ea-6b7cab1ff7b8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:55:57.410782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-79b85784-5dcd-4899-83ea-6b7cab1ff7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:57.507532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 747/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:55:57.796498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7547a6-2279-4d2f-bed4-8faa26ea64da None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:55:57.798008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0c7547a6-2279-4d2f-bed4-8faa26ea64da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:57.899749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7547a6-2279-4d2f-bed4-8faa26ea64da None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:55:57.972406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:57.973972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74095-942d-43ca-83e9-7bdaf78a499e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:55:57.974694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74095-942d-43ca-83e9-7bdaf78a499e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:55:57.975219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74095-942d-43ca-83e9-7bdaf78a499e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:55:57.975671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74095-942d-43ca-83e9-7bdaf78a499e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:55:57.977420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-68c74095-942d-43ca-83e9-7bdaf78a499e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:55:58.085497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c74095-942d-43ca-83e9-7bdaf78a499e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:55:58.086948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c74095-942d-43ca-83e9-7bdaf78a499e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:55:58.105566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 740/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:56:00.380512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84192547-9f7b-4a66-8271-1b40766d294e None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:56:00.381349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84192547-9f7b-4a66-8271-1b40766d294e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:56:00.381349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84192547-9f7b-4a66-8271-1b40766d294e None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:56:00.382650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 748/1488] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:56:00.388541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7411f77-c8f6-47ef-9174-8c1325335645 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:56:00.389205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7411f77-c8f6-47ef-9174-8c1325335645 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:56:00.389205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7411f77-c8f6-47ef-9174-8c1325335645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:56:00.453564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d7411f77-c8f6-47ef-9174-8c1325335645 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:56:00.454776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d7411f77-c8f6-47ef-9174-8c1325335645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:56:00.506404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:56:00.549532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 741/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:56:00.838983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84192547-9f7b-4a66-8271-1b40766d294e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:56:00.840550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-84192547-9f7b-4a66-8271-1b40766d294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:56:00.877801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:56:00.945544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84192547-9f7b-4a66-8271-1b40766d294e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:56:01.018565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44fb7d-6404-4a17-8197-130687dfd666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:56:01.019185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44fb7d-6404-4a17-8197-130687dfd666 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:56:01.019469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44fb7d-6404-4a17-8197-130687dfd666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:56:01.019738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44fb7d-6404-4a17-8197-130687dfd666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:56:01.021331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0b44fb7d-6404-4a17-8197-130687dfd666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:56:01.101918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:56:01.130487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44fb7d-6404-4a17-8197-130687dfd666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:56:01.132234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44fb7d-6404-4a17-8197-130687dfd666 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:56:01.150425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 749/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:56:03.507666 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba1648-b4e5-44c0-bb93-bd525f1c2b18 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:56:03.508271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba1648-b4e5-44c0-bb93-bd525f1c2b18 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:56:03.508271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba1648-b4e5-44c0-bb93-bd525f1c2b18 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:56:03.509546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 742/1491] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 24 04:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:56:03.514883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf638f6-5fa0-4672-828d-f7f26b95e12e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:56:03.515302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf638f6-5fa0-4672-828d-f7f26b95e12e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:56:03.515437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf638f6-5fa0-4672-828d-f7f26b95e12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:56:03.580972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4cf638f6-5fa0-4672-828d-f7f26b95e12e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:56:03.582191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4cf638f6-5fa0-4672-828d-f7f26b95e12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:56:03.678529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 750/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 24 04:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:56:03.969770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba1648-b4e5-44c0-bb93-bd525f1c2b18 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:56:03.971326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ddba1648-b4e5-44c0-bb93-bd525f1c2b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:56:04.076273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba1648-b4e5-44c0-bb93-bd525f1c2b18 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:56:04.147872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67625-c6e5-441f-88e4-b42f4b466672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:56:04.148456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67625-c6e5-441f-88e4-b42f4b466672 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:56:04.148726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67625-c6e5-441f-88e4-b42f4b466672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:56:04.148989 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67625-c6e5-441f-88e4-b42f4b466672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:56:04.150557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6ba67625-c6e5-441f-88e4-b42f4b466672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:56:04.159584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:56:04.259238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67625-c6e5-441f-88e4-b42f4b466672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:56:04.260657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67625-c6e5-441f-88e4-b42f4b466672 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:56:04.279032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 743/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:56:13.676933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=82 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:56:14.276729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=50 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:16.975599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190c6a7-faf5-47fe-a800-efb1047ad2f0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:16.976169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190c6a7-faf5-47fe-a800-efb1047ad2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:16.976169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190c6a7-faf5-47fe-a800-efb1047ad2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:17.051490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0190c6a7-faf5-47fe-a800-efb1047ad2f0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:57:17.052705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0190c6a7-faf5-47fe-a800-efb1047ad2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:17.149022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 751/1494] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 04:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:57:17.157536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7b49-f9a9-4667-af4a-74389de0e5f9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:17.158039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7b49-f9a9-4667-af4a-74389de0e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:17.158146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7b49-f9a9-4667-af4a-74389de0e5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:17.234065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-746c7b49-f9a9-4667-af4a-74389de0e5f9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:57:17.235227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-746c7b49-f9a9-4667-af4a-74389de0e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:17.329440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 744/1495] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 04:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:57:17.334026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190c6a7-faf5-47fe-a800-efb1047ad2f0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:17.335237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0190c6a7-faf5-47fe-a800-efb1047ad2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:17.347020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190c6a7-faf5-47fe-a800-efb1047ad2f0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:17.407698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:17.441413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:17.442009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:17.442278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:17.442541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:17.443198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 04:57:17.443495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:17.444483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:57:17.444483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: warnings.warn(msg) Sep 24 04:57:17.444483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: Sep 24 04:57:17.445360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:17.456386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 752/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 04:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:57:17.464785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7b49-f9a9-4667-af4a-74389de0e5f9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:17.473708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7b49-f9a9-4667-af4a-74389de0e5f9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:17.534625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:17.567631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:17.568227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:17.568499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:17.568758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:17.569369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:17.571131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:57:17.571131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: warnings.warn(msg) Sep 24 04:57:17.571131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: Sep 24 04:57:17.572848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:17.635818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 745/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 04:57:17 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:57:17.640018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:17.641527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:17.675948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e1784-cf7e-428e-9f5a-86fd8585f482 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:17.770507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:17.771176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:17.771455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:17.771754 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:17.772384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:17.773385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:57:17.773385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: warnings.warn(msg) Sep 24 04:57:17.773385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: Sep 24 04:57:17.774588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:17.816750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 753/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 04:57:17 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 04:57:17.820796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:17.822628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:17.884623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0b7f-34a2-4f56-a1b1-ee29d9515373 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:17.967593 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:17.979841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:17.980428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:17.980699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:17.980962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:17.981595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:17.982579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:57:17.982579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: warnings.warn(msg) Sep 24 04:57:17.982579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: Sep 24 04:57:17.983501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:17.995980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 746/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 04:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 04:57:18.000008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:18.001497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:18.013504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb766-b70b-43f9-bdeb-6d7cf9a87bec admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:18.038926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:18.110249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea991f-aff9-45ac-8c8b-f0379ab4d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:18.110774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea991f-aff9-45ac-8c8b-f0379ab4d3df admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:18.111057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea991f-aff9-45ac-8c8b-f0379ab4d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:18.111322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea991f-aff9-45ac-8c8b-f0379ab4d3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:18.111975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea991f-aff9-45ac-8c8b-f0379ab4d3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:18.113003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-f3ea991f-aff9-45ac-8c8b-f0379ab4d3df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:57:18.113003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: warnings.warn(msg) Sep 24 04:57:18.113003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: Sep 24 04:57:18.113880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea991f-aff9-45ac-8c8b-f0379ab4d3df admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:18.126357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 754/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 04:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 04:57:18.130894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:18.132395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:18.165771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a902-4cdb-4863-8708-4ce589b49a5d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:18.257594 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acccb41-d6b1-49df-958d-9e3b802c66db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:18.258238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acccb41-d6b1-49df-958d-9e3b802c66db admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:18.258515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acccb41-d6b1-49df-958d-9e3b802c66db admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:18.258810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acccb41-d6b1-49df-958d-9e3b802c66db admin admin] PATH_INFO: `/v3/projects/f57c679194e84549a389446d6c8b6017/users/3a057e15f0c44d238ce60b7e4009bca8/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:18.281663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acccb41-d6b1-49df-958d-9e3b802c66db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57c679194e84549a389446d6c8b6017, user_id=3a057e15f0c44d238ce60b7e4009bca8, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:18.282671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-0acccb41-d6b1-49df-958d-9e3b802c66db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:57:18.282671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: warnings.warn(msg) Sep 24 04:57:18.282671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: Sep 24 04:57:18.284616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acccb41-d6b1-49df-958d-9e3b802c66db admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:18.307961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 747/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 04:57:18 2022] PUT /identity/v3/projects/f57c679194e84549a389446d6c8b6017/users/3a057e15f0c44d238ce60b7e4009bca8/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:57:18.320011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0a07-7960-48c3-99df-e579a027d898 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:18.320326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0a07-7960-48c3-99df-e579a027d898 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:18.320646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0a07-7960-48c3-99df-e579a027d898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:18.379075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-046d0a07-7960-48c3-99df-e579a027d898 None None] MFA Rules not processed for user `3a057e15f0c44d238ce60b7e4009bca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:57:18.380478 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-046d0a07-7960-48c3-99df-e579a027d898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:18.455855 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 755/1502] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 04:57:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:57:18.469794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049223-c26a-40cf-823a-59e979f6850c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:18.470079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049223-c26a-40cf-823a-59e979f6850c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:18.470350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049223-c26a-40cf-823a-59e979f6850c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:18.471728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 748/1503] 10.222.0.26 () {54 vars in 963 bytes} [Sat Sep 24 04:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:57:18.476741 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c775-f424-47db-97d6-0914b7c47f4a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:18.477026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c775-f424-47db-97d6-0914b7c47f4a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:18.477326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c775-f424-47db-97d6-0914b7c47f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:18.510272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:18.555241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9455c775-f424-47db-97d6-0914b7c47f4a None None] MFA Rules not processed for user `ac3f250eacf044f1b760f3b75d4ba33a`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:57:18.557070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9455c775-f424-47db-97d6-0914b7c47f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:18.634909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 756/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Sep 24 04:57:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:57:18.642827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77049223-c26a-40cf-823a-59e979f6850c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:18.644332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-77049223-c26a-40cf-823a-59e979f6850c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:18.700246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:18.761906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77049223-c26a-40cf-823a-59e979f6850c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:18.837833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:18.838427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:18.838699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:18.838988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:18.840559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:18.944018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:18.945526 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:18.949621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:18.964914 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 749/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:57:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:57:19.010553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34686b-8b6f-42f9-a6ca-3fd430cde952 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:19.010982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34686b-8b6f-42f9-a6ca-3fd430cde952 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:19.011130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34686b-8b6f-42f9-a6ca-3fd430cde952 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:19.012377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 757/1506] 10.222.0.26 () {52 vars in 830 bytes} [Sat Sep 24 04:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:57:19.015880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:19.017081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:19.113719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b29a0-ba75-42fa-90ed-72fd506aa092 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:19.205442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:19.206068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:19.206257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:19.206528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] PATH_INFO: `/v3/users/3a057e15f0c44d238ce60b7e4009bca8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:19.219948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a057e15f0c44d238ce60b7e4009bca8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:19.220954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:57:19.220954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: warnings.warn(msg) Sep 24 04:57:19.220954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: Sep 24 04:57:19.222161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:19.232491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:19.288539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a057e15f0c44d238ce60b7e4009bca8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:19.297871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a057e15f0c44d238ce60b7e4009bca8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:19.298301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a057e15f0c44d238ce60b7e4009bca8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:19.298829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a057e15f0c44d238ce60b7e4009bca8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:19.312723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a057e15f0c44d238ce60b7e4009bca8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:19.340488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 750/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 04:57:19 2022] DELETE /identity/v3/users/3a057e15f0c44d238ce60b7e4009bca8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:57:19.344854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3357a4-fbc9-4951-83e7-731c7a892e2a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:19.345205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3357a4-fbc9-4951-83e7-731c7a892e2a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:19.345483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3357a4-fbc9-4951-83e7-731c7a892e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:19.402861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4a3357a4-fbc9-4951-83e7-731c7a892e2a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:57:19.404068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4a3357a4-fbc9-4951-83e7-731c7a892e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:19.477413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:19.491653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 758/1508] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 04:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:57:19.502657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:19.503879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:19.604853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196691-42ca-452a-aacf-42e7285d44ef admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:19.661539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:19.683373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408898-e43d-4681-940f-c32124f40cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:19.683977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408898-e43d-4681-940f-c32124f40cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:19.684251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408898-e43d-4681-940f-c32124f40cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:19.684519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408898-e43d-4681-940f-c32124f40cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:19.686104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f6408898-e43d-4681-940f-c32124f40cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:19.793256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6408898-e43d-4681-940f-c32124f40cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:19.794663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6408898-e43d-4681-940f-c32124f40cd7 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:19.813068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 751/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:57:20.125820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3357a4-fbc9-4951-83e7-731c7a892e2a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:57:20.127212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4a3357a4-fbc9-4951-83e7-731c7a892e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:57:20.139696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3357a4-fbc9-4951-83e7-731c7a892e2a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:57:20.237441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:57:20.238057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:57:20.238332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:57:20.238596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] PATH_INFO: `/v3/projects/f57c679194e84549a389446d6c8b6017` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:57:20.248580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57c679194e84549a389446d6c8b6017)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:57:20.249599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 04:57:20.249599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: warnings.warn(msg) Sep 24 04:57:20.249599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: Sep 24 04:57:20.250794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:57:20.307736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57c679194e84549a389446d6c8b6017', 'request_id': 'req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:20.313610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57c679194e84549a389446d6c8b6017', 'request_id': 'req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:20.324153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57c679194e84549a389446d6c8b6017', 'request_id': 'req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:20.353869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] The token cache is being invalidate because project f57c679194e84549a389446d6c8b6017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 04:57:20.354154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:20.354576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b4b9b6f5-1a38-4004-b3c8-f6451f009ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 04:57:20.355999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 759/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 04:57:20 2022] DELETE /identity/v3/projects/f57c679194e84549a389446d6c8b6017 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 04:57:29.810856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=62 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:57:30.351758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:58:52.099185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884666-f284-4248-b2e1-5c6a3a886cc5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:52.099798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884666-f284-4248-b2e1-5c6a3a886cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:52.099798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884666-f284-4248-b2e1-5c6a3a886cc5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:52.101047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:58:52.105912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25152a-afb2-47ab-9651-40994407ee0a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:52.106333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25152a-afb2-47ab-9651-40994407ee0a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:52.106461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25152a-afb2-47ab-9651-40994407ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:52.186800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-be25152a-afb2-47ab-9651-40994407ee0a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:58:52.188011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-be25152a-afb2-47ab-9651-40994407ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:58:52.290805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:58:52.448950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884666-f284-4248-b2e1-5c6a3a886cc5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:58:52.451068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-da884666-f284-4248-b2e1-5c6a3a886cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:58:52.568253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884666-f284-4248-b2e1-5c6a3a886cc5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:58:52.573811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279381b7-e126-4f58-8f91-5e39f1766226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:58:52.574410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279381b7-e126-4f58-8f91-5e39f1766226 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:52.574689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279381b7-e126-4f58-8f91-5e39f1766226 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:52.574992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279381b7-e126-4f58-8f91-5e39f1766226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:52.583056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279381b7-e126-4f58-8f91-5e39f1766226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:58:52.584615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279381b7-e126-4f58-8f91-5e39f1766226 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:58:52.594163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 753/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:58:53.683362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937f4d4-92cd-4278-945e-d511106a6233 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:53.683857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937f4d4-92cd-4278-945e-d511106a6233 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:53.683965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937f4d4-92cd-4278-945e-d511106a6233 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:53.685266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:58:53.691639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bab41-d4b7-414b-9620-973750edf5b6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:53.692147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bab41-d4b7-414b-9620-973750edf5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:53.692265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bab41-d4b7-414b-9620-973750edf5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:53.712322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0b1bab41-d4b7-414b-9620-973750edf5b6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:58:53.713518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0b1bab41-d4b7-414b-9620-973750edf5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:58:53.721251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:58:53.874299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937f4d4-92cd-4278-945e-d511106a6233 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:58:53.889489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937f4d4-92cd-4278-945e-d511106a6233 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:58:53.894848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582abff4-4018-4769-91b9-03c82697eeb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:58:53.895437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abff4-4018-4769-91b9-03c82697eeb8 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:53.895715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abff4-4018-4769-91b9-03c82697eeb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:53.895987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abff4-4018-4769-91b9-03c82697eeb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:53.904022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582abff4-4018-4769-91b9-03c82697eeb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:58:53.905600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582abff4-4018-4769-91b9-03c82697eeb8 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:58:53.915109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 762/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:58:54.018477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63230b8-4f5a-47f2-a4da-10c68882a0dc None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:54.019083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63230b8-4f5a-47f2-a4da-10c68882a0dc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:54.019586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63230b8-4f5a-47f2-a4da-10c68882a0dc None None] PATH_INFO: `/v3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:54.022130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 755/1517] 10.222.0.55 () {54 vars in 925 bytes} [Sat Sep 24 04:58:54 2022] GET /identity/v3 => generated 255 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 04:58:54.028750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9629c8c-965b-463a-9566-ff4ead459ef9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:54.029122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9629c8c-965b-463a-9566-ff4ead459ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:54.029405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9629c8c-965b-463a-9566-ff4ead459ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:54.091385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c9629c8c-965b-463a-9566-ff4ead459ef9 None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:58:54.092578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c9629c8c-965b-463a-9566-ff4ead459ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:58:54.109306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:58:54.163562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 763/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Sat Sep 24 04:58:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:58:57.680795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136babc-8220-4ac4-8153-e3d06da09942 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:57.681244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136babc-8220-4ac4-8153-e3d06da09942 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:57.681347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136babc-8220-4ac4-8153-e3d06da09942 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:57.682653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 756/1519] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 24 04:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:58:57.687726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e56e6-31df-4e99-bf03-17f3dd0e5403 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:57.688173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e56e6-31df-4e99-bf03-17f3dd0e5403 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:57.688271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e56e6-31df-4e99-bf03-17f3dd0e5403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:57.709154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e47e56e6-31df-4e99-bf03-17f3dd0e5403 None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:58:57.710374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e47e56e6-31df-4e99-bf03-17f3dd0e5403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:58:57.719160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 764/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 24 04:58:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:58:57.726713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136babc-8220-4ac4-8153-e3d06da09942 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:58:57.740206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136babc-8220-4ac4-8153-e3d06da09942 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:58:57.745951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e4830-a499-46e2-a429-e6fd9c77751d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:58:57.746525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4830-a499-46e2-a429-e6fd9c77751d service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:58:57.746891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4830-a499-46e2-a429-e6fd9c77751d service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:58:57.747161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4830-a499-46e2-a429-e6fd9c77751d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:58:57.755797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e4830-a499-46e2-a429-e6fd9c77751d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:58:57.757357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e4830-a499-46e2-a429-e6fd9c77751d service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:58:57.767865 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 757/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:58:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:59:05.403188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837966f-4476-41e6-8b64-3b441425254b None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:05.403770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837966f-4476-41e6-8b64-3b441425254b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:05.403770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837966f-4476-41e6-8b64-3b441425254b None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:05.405043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:59:05.411015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40e89-fb93-4e4d-a39f-ff41cc06b780 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:05.411477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40e89-fb93-4e4d-a39f-ff41cc06b780 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:05.411576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40e89-fb93-4e4d-a39f-ff41cc06b780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:05.430907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d8c40e89-fb93-4e4d-a39f-ff41cc06b780 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:59:05.432092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d8c40e89-fb93-4e4d-a39f-ff41cc06b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:05.439685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:59:05.593690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837966f-4476-41e6-8b64-3b441425254b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:59:05.608694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837966f-4476-41e6-8b64-3b441425254b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:59:05.613961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787880fd-83b1-429c-bd2e-efa0a39871a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:59:05.614540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787880fd-83b1-429c-bd2e-efa0a39871a5 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:05.614845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787880fd-83b1-429c-bd2e-efa0a39871a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:05.615127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787880fd-83b1-429c-bd2e-efa0a39871a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:05.623849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787880fd-83b1-429c-bd2e-efa0a39871a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:59:05.625401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787880fd-83b1-429c-bd2e-efa0a39871a5 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:59:05.634826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 766/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:59:06.717234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbca6-3785-48f6-bfa8-02c6d1cbf923 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:06.717781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbca6-3785-48f6-bfa8-02c6d1cbf923 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:06.717781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbca6-3785-48f6-bfa8-02c6d1cbf923 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:06.719148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 04:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:59:06.725103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8aa0d-d784-4469-9eb2-6e9fee99a811 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:06.725535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8aa0d-d784-4469-9eb2-6e9fee99a811 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:06.725635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8aa0d-d784-4469-9eb2-6e9fee99a811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:06.745784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-83c8aa0d-d784-4469-9eb2-6e9fee99a811 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:59:06.746975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-83c8aa0d-d784-4469-9eb2-6e9fee99a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:06.754578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:59:06.907937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dbca6-3785-48f6-bfa8-02c6d1cbf923 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:59:06.922692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dbca6-3785-48f6-bfa8-02c6d1cbf923 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:59:06.927985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f98af-7d20-48e5-936e-e50b272480db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:59:06.928564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f98af-7d20-48e5-936e-e50b272480db service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:06.928840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f98af-7d20-48e5-936e-e50b272480db service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:06.929110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f98af-7d20-48e5-936e-e50b272480db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:06.937602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f98af-7d20-48e5-936e-e50b272480db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:59:06.939195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f98af-7d20-48e5-936e-e50b272480db service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:59:06.948554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 760/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:59:10.929026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382011a-4f2c-4d6a-97fc-82caca595ebb None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:10.929565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382011a-4f2c-4d6a-97fc-82caca595ebb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:10.929565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382011a-4f2c-4d6a-97fc-82caca595ebb None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:10.931389 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:59:10.936511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d545b-ef0b-4bd9-a914-c8c432ee05e2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:10.936950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d545b-ef0b-4bd9-a914-c8c432ee05e2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:10.937046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d545b-ef0b-4bd9-a914-c8c432ee05e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:10.956878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ff5d545b-ef0b-4bd9-a914-c8c432ee05e2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:59:10.958052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff5d545b-ef0b-4bd9-a914-c8c432ee05e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:10.966258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:59:11.260887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382011a-4f2c-4d6a-97fc-82caca595ebb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:59:11.262563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5382011a-4f2c-4d6a-97fc-82caca595ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:11.338864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382011a-4f2c-4d6a-97fc-82caca595ebb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:59:11.342376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c2a63-385b-4497-b728-ee86e0b96eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:59:11.342998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c2a63-385b-4497-b728-ee86e0b96eca service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:11.343276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c2a63-385b-4497-b728-ee86e0b96eca service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:11.343547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c2a63-385b-4497-b728-ee86e0b96eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:11.353024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c2a63-385b-4497-b728-ee86e0b96eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:59:11.354435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c2a63-385b-4497-b728-ee86e0b96eca service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:59:11.363715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 769/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:59:13.549360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a90104-75b1-459b-bc34-1e5898483cc3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:13.549856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a90104-75b1-459b-bc34-1e5898483cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:13.549962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a90104-75b1-459b-bc34-1e5898483cc3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:13.551281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:59:13.557751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e83c7c-bafc-4810-8ae3-47684fbfe2d9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:13.558237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e83c7c-bafc-4810-8ae3-47684fbfe2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:13.558350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e83c7c-bafc-4810-8ae3-47684fbfe2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:13.578018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c0e83c7c-bafc-4810-8ae3-47684fbfe2d9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:59:13.579266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c0e83c7c-bafc-4810-8ae3-47684fbfe2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:13.587211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:59:13.882179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a90104-75b1-459b-bc34-1e5898483cc3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:59:13.893517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a90104-75b1-459b-bc34-1e5898483cc3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:59:13.896995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf6994-0f71-40a7-a30d-47cecebee488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:59:13.897573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf6994-0f71-40a7-a30d-47cecebee488 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:13.897842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf6994-0f71-40a7-a30d-47cecebee488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:13.898106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf6994-0f71-40a7-a30d-47cecebee488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:13.907488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf6994-0f71-40a7-a30d-47cecebee488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:59:13.908883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf6994-0f71-40a7-a30d-47cecebee488 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:59:13.918418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 763/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:59:17.702549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fc31-aeb7-4bf3-a7ed-0558274956b3 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:17.703958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fc31-aeb7-4bf3-a7ed-0558274956b3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:17.704248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fc31-aeb7-4bf3-a7ed-0558274956b3 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:17.705850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:59:17.712057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b6cda-4cf1-4fea-bd09-7d8f58be495f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:17.713069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b6cda-4cf1-4fea-bd09-7d8f58be495f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:17.713226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b6cda-4cf1-4fea-bd09-7d8f58be495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:17.733773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b97b6cda-4cf1-4fea-bd09-7d8f58be495f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:59:17.734990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b97b6cda-4cf1-4fea-bd09-7d8f58be495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:17.742638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:59:18.052436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fc31-aeb7-4bf3-a7ed-0558274956b3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:59:18.054101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fc93fc31-aeb7-4bf3-a7ed-0558274956b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:18.117611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:59:18.132065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fc31-aeb7-4bf3-a7ed-0558274956b3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:59:18.135603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294352-09d0-4c02-8b6d-8d1e151e14f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:59:18.136194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294352-09d0-4c02-8b6d-8d1e151e14f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:18.136466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294352-09d0-4c02-8b6d-8d1e151e14f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:18.136731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294352-09d0-4c02-8b6d-8d1e151e14f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:18.145320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e294352-09d0-4c02-8b6d-8d1e151e14f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:59:18.146734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e294352-09d0-4c02-8b6d-8d1e151e14f7 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:59:18.155889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 772/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:59:20.282501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cbcb-b8ee-4dfd-861e-6f13e2f9c46a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:20.283096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cbcb-b8ee-4dfd-861e-6f13e2f9c46a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:20.283096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cbcb-b8ee-4dfd-861e-6f13e2f9c46a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:20.284457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 04:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 04:59:20.289770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e33ac3-a6a7-43b8-b71c-e2b4ddb5c016 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:20.290802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e33ac3-a6a7-43b8-b71c-e2b4ddb5c016 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:20.290916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e33ac3-a6a7-43b8-b71c-e2b4ddb5c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:20.310442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a0e33ac3-a6a7-43b8-b71c-e2b4ddb5c016 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 04:59:20.311643 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a0e33ac3-a6a7-43b8-b71c-e2b4ddb5c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:20.319264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 04:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 04:59:20.618845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01cbcb-b8ee-4dfd-861e-6f13e2f9c46a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 04:59:20.620569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ec01cbcb-b8ee-4dfd-861e-6f13e2f9c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 04:59:20.628013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:59:20.635306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01cbcb-b8ee-4dfd-861e-6f13e2f9c46a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 04:59:20.638817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af143df-ae69-4ee4-951f-0e12b33cc3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 04:59:20.639405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af143df-ae69-4ee4-951f-0e12b33cc3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 04:59:20.639678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af143df-ae69-4ee4-951f-0e12b33cc3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 04:59:20.639942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af143df-ae69-4ee4-951f-0e12b33cc3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 04:59:20.648829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af143df-ae69-4ee4-951f-0e12b33cc3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 04:59:20.651045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af143df-ae69-4ee4-951f-0e12b33cc3e6 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 04:59:20.660485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 766/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 04:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 04:59:30.305211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=11 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:59:30.656223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:47.998845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339629fe-8d61-4c89-bb0a-afb5d3d11d93 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:47.999475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339629fe-8d61-4c89-bb0a-afb5d3d11d93 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:47.999475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339629fe-8d61-4c89-bb0a-afb5d3d11d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.027560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-339629fe-8d61-4c89-bb0a-afb5d3d11d93 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.028787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-339629fe-8d61-4c89-bb0a-afb5d3d11d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.037288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 774/1540] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.047193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b22ca-6044-4cc3-934f-d0f22988cb30 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.047803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b22ca-6044-4cc3-934f-d0f22988cb30 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.047803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b22ca-6044-4cc3-934f-d0f22988cb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.076623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f3fe-f43a-4a32-a7e3-2e10af8c5268 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.076962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f3fe-f43a-4a32-a7e3-2e10af8c5268 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.077166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f3fe-f43a-4a32-a7e3-2e10af8c5268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.078874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-009b22ca-6044-4cc3-934f-d0f22988cb30 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.080193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-009b22ca-6044-4cc3-934f-d0f22988cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.093306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 767/1541] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.102589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b22ca-6044-4cc3-934f-d0f22988cb30 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.112228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-da37f3fe-f43a-4a32-a7e3-2e10af8c5268 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.113655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-da37f3fe-f43a-4a32-a7e3-2e10af8c5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.121562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b22ca-6044-4cc3-934f-d0f22988cb30 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.132865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 775/1542] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:00:48.135028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471594b-a262-4814-9c82-27314a5f1702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.135676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471594b-a262-4814-9c82-27314a5f1702 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.136020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471594b-a262-4814-9c82-27314a5f1702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.136291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471594b-a262-4814-9c82-27314a5f1702 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.136951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471594b-a262-4814-9c82-27314a5f1702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:48.137254 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471594b-a262-4814-9c82-27314a5f1702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.138269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-b471594b-a262-4814-9c82-27314a5f1702 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 05:00:48.138269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: warnings.warn(msg) Sep 24 05:00:48.138269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: Sep 24 05:00:48.141230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471594b-a262-4814-9c82-27314a5f1702 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.142644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f11771-7e93-4d89-b9c8-485ebbc7c276 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.142960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f11771-7e93-4d89-b9c8-485ebbc7c276 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.143227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f11771-7e93-4d89-b9c8-485ebbc7c276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.163266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 768/1543] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:00:48.168250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9a42-81b9-4a09-9a70-483fd81f2fee None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.168534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9a42-81b9-4a09-9a70-483fd81f2fee None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.168805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9a42-81b9-4a09-9a70-483fd81f2fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.179303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-33f11771-7e93-4d89-b9c8-485ebbc7c276 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.180509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-33f11771-7e93-4d89-b9c8-485ebbc7c276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.195715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 776/1544] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:00:48.197951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f11771-7e93-4d89-b9c8-485ebbc7c276 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.210780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f11771-7e93-4d89-b9c8-485ebbc7c276 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.210983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-be7d9a42-81b9-4a09-9a70-483fd81f2fee None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.211248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-be7d9a42-81b9-4a09-9a70-483fd81f2fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.217434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.218069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.218347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.218608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.219295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.220329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 05:00:48.220329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: warnings.warn(msg) Sep 24 05:00:48.220329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: Sep 24 05:00:48.221536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.236077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 769/1545] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.237337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f69c-cd40-4e36-9b69-84d724b55cf3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.237610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f69c-cd40-4e36-9b69-84d724b55cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.237865 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f69c-cd40-4e36-9b69-84d724b55cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.265177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a158f69c-cd40-4e36-9b69-84d724b55cf3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.266377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a158f69c-cd40-4e36-9b69-84d724b55cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.285666 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 770/1546] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.287116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16760c43-cca3-4b1c-9a15-1890d9b3c748 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.287405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16760c43-cca3-4b1c-9a15-1890d9b3c748 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.287671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16760c43-cca3-4b1c-9a15-1890d9b3c748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.303238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 777/1547] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:48.303942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.317683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-16760c43-cca3-4b1c-9a15-1890d9b3c748 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.319073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-16760c43-cca3-4b1c-9a15-1890d9b3c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.380626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0097-f215-4af8-8548-ce29aba500b3 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.382340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 771/1548] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.383581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b432-d325-4d03-934f-7c9c661776e1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.383864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b432-d325-4d03-934f-7c9c661776e1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.384187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b432-d325-4d03-934f-7c9c661776e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.386464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da168c70-31e9-412b-a4ca-6ce75862dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.387370 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da168c70-31e9-412b-a4ca-6ce75862dc4a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.388055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da168c70-31e9-412b-a4ca-6ce75862dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.388596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da168c70-31e9-412b-a4ca-6ce75862dc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.389524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da168c70-31e9-412b-a4ca-6ce75862dc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:48.390033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da168c70-31e9-412b-a4ca-6ce75862dc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.391912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da168c70-31e9-412b-a4ca-6ce75862dc4a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.406644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 778/1549] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:00:48.407924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668f4ad-beaa-431b-8382-55f36376a0b9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.408204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668f4ad-beaa-431b-8382-55f36376a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.408473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668f4ad-beaa-431b-8382-55f36376a0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.410309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c5a0b432-d325-4d03-934f-7c9c661776e1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.411874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5a0b432-d325-4d03-934f-7c9c661776e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.424240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 772/1550] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.424822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518a56f-1a33-4950-8705-879d7d564d29 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.425106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518a56f-1a33-4950-8705-879d7d564d29 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.425381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518a56f-1a33-4950-8705-879d7d564d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.431698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6668f4ad-beaa-431b-8382-55f36376a0b9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.433231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6668f4ad-beaa-431b-8382-55f36376a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.443617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 779/1551] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.444552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668f4ad-beaa-431b-8382-55f36376a0b9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.445996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d518a56f-1a33-4950-8705-879d7d564d29 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.447801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d518a56f-1a33-4950-8705-879d7d564d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.455919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668f4ad-beaa-431b-8382-55f36376a0b9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.456864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 773/1552] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.458010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c193-72b5-4096-98ae-df9f8c4853df None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.458289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c193-72b5-4096-98ae-df9f8c4853df None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.458558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c193-72b5-4096-98ae-df9f8c4853df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.460644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0357bf-c6f3-4be4-8f2a-dccae7e8f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.461231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0357bf-c6f3-4be4-8f2a-dccae7e8f882 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.461556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0357bf-c6f3-4be4-8f2a-dccae7e8f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.461770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0357bf-c6f3-4be4-8f2a-dccae7e8f882 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.462570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0357bf-c6f3-4be4-8f2a-dccae7e8f882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.464845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0357bf-c6f3-4be4-8f2a-dccae7e8f882 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.478143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2a54c193-72b5-4096-98ae-df9f8c4853df None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.479769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2a54c193-72b5-4096-98ae-df9f8c4853df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.488929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 774/1553] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.496919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 780/1554] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:48.496919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0357bf-c6f3-4be4-8f2a-dccae7e8f882 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.497128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2c88e-98cb-4a0c-bb06-9e1b985ef0b7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.497128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2c88e-98cb-4a0c-bb06-9e1b985ef0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.497128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2c88e-98cb-4a0c-bb06-9e1b985ef0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.506541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0357bf-c6f3-4be4-8f2a-dccae7e8f882 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.512079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8101d24-2069-4072-85e6-a563df3c26ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.512671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8101d24-2069-4072-85e6-a563df3c26ec admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.512951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8101d24-2069-4072-85e6-a563df3c26ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.513225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8101d24-2069-4072-85e6-a563df3c26ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.513320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ddc2c88e-98cb-4a0c-bb06-9e1b985ef0b7 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.513851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8101d24-2069-4072-85e6-a563df3c26ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.514491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ddc2c88e-98cb-4a0c-bb06-9e1b985ef0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.515837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8101d24-2069-4072-85e6-a563df3c26ec admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.522570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 775/1555] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.523376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2c88e-98cb-4a0c-bb06-9e1b985ef0b7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.533397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2c88e-98cb-4a0c-bb06-9e1b985ef0b7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.538199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.538828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.539109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.539379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.543786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:48.544106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.545717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.549550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 781/1556] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:48.550877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66efa6-4863-461a-8959-cb9bad759efb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.551156 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66efa6-4863-461a-8959-cb9bad759efb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.551420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66efa6-4863-461a-8959-cb9bad759efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.560532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 776/1557] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:00:48.561438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.574624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffce2-01d5-423c-b47f-0fd6b5fbca0d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.576704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2e66efa6-4863-461a-8959-cb9bad759efb None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.578289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2e66efa6-4863-461a-8959-cb9bad759efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.633866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:48.636525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.637112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.637388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.637660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.638291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:48.638593 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.640300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.648178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 782/1558] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.649445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882572f-8232-43e2-a024-2e6466dab8a0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.650286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882572f-8232-43e2-a024-2e6466dab8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.650595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882572f-8232-43e2-a024-2e6466dab8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.661686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 777/1559] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:00:48.661686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.668401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70041b9-c560-48ad-a5f0-7a94b21cb1c5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.672961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5263c-b8a8-44aa-b00f-fb9ee424878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.673550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5263c-b8a8-44aa-b00f-fb9ee424878f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.673825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5263c-b8a8-44aa-b00f-fb9ee424878f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.674092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5263c-b8a8-44aa-b00f-fb9ee424878f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.674734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5263c-b8a8-44aa-b00f-fb9ee424878f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.676356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5263c-b8a8-44aa-b00f-fb9ee424878f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.679518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7882572f-8232-43e2-a024-2e6466dab8a0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.680801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7882572f-8232-43e2-a024-2e6466dab8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.686869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 778/1560] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:48.688042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f61225-8c62-499f-84e9-fbab4aeed65e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.688325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f61225-8c62-499f-84e9-fbab4aeed65e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.688599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f61225-8c62-499f-84e9-fbab4aeed65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.691435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 783/1561] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.692286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882572f-8232-43e2-a024-2e6466dab8a0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.701653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882572f-8232-43e2-a024-2e6466dab8a0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.706124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.706701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.708012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.708281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.708672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-28f61225-8c62-499f-84e9-fbab4aeed65e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.708914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:48.709213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.709822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-28f61225-8c62-499f-84e9-fbab4aeed65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.710823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.717773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 779/1562] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.718916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f61225-8c62-499f-84e9-fbab4aeed65e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.724286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:48.726788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 784/1563] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:00:48.727621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.729770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f61225-8c62-499f-84e9-fbab4aeed65e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.737217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c42835-004a-4f3d-bc85-e8a30134de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.737816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42835-004a-4f3d-bc85-e8a30134de65 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.738091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42835-004a-4f3d-bc85-e8a30134de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.738364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42835-004a-4f3d-bc85-e8a30134de65 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.739021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c42835-004a-4f3d-bc85-e8a30134de65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.740023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-48c42835-004a-4f3d-bc85-e8a30134de65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 05:00:48.740023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: warnings.warn(msg) Sep 24 05:00:48.740023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: Sep 24 05:00:48.741265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c42835-004a-4f3d-bc85-e8a30134de65 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.744298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5bf6-0ac7-4809-9cac-22c91fcfdf5d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.748954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d75b-ffee-457a-b49c-2139d5e3117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.749591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d75b-ffee-457a-b49c-2139d5e3117e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.749977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d75b-ffee-457a-b49c-2139d5e3117e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.750251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d75b-ffee-457a-b49c-2139d5e3117e admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.750913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d75b-ffee-457a-b49c-2139d5e3117e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.753068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d75b-ffee-457a-b49c-2139d5e3117e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.765031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 780/1564] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:48.766449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed06a-9ee8-4523-8797-33dc4c9b384e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.766675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed06a-9ee8-4523-8797-33dc4c9b384e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.766973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed06a-9ee8-4523-8797-33dc4c9b384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.783644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 785/1565] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:48.784441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d75b-ffee-457a-b49c-2139d5e3117e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.786460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4b5ed06a-9ee8-4523-8797-33dc4c9b384e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:48.787854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4b5ed06a-9ee8-4523-8797-33dc4c9b384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:48.852846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 781/1566] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:48.853064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d75b-ffee-457a-b49c-2139d5e3117e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.853587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed06a-9ee8-4523-8797-33dc4c9b384e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.858337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4f88c-762d-44e0-b10f-1fe32532b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.858974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f88c-762d-44e0-b10f-1fe32532b1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.859253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f88c-762d-44e0-b10f-1fe32532b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.859527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f88c-762d-44e0-b10f-1fe32532b1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.860164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4f88c-762d-44e0-b10f-1fe32532b1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.862067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4f88c-762d-44e0-b10f-1fe32532b1f9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.862900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed06a-9ee8-4523-8797-33dc4c9b384e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.867467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f900-1c91-4431-bd57-8df19dcdd721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.868061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f900-1c91-4431-bd57-8df19dcdd721 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.868361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f900-1c91-4431-bd57-8df19dcdd721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.868661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f900-1c91-4431-bd57-8df19dcdd721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.869301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f900-1c91-4431-bd57-8df19dcdd721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.870904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f900-1c91-4431-bd57-8df19dcdd721 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.885966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 782/1567] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:48.885966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f900-1c91-4431-bd57-8df19dcdd721 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.893381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 786/1568] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:48.893381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4f88c-762d-44e0-b10f-1fe32532b1f9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.895508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f900-1c91-4431-bd57-8df19dcdd721 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.952383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.952985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.953266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.953537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.954180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:48.954482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.954657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4f88c-762d-44e0-b10f-1fe32532b1f9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.956118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.959566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.960208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.960528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.960800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.961438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:48.961737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.964012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.969286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 783/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:00:48.972123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.976522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 787/1570] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:00:48.977360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:48.982789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd3f2e-a7f7-4e6a-ae81-cec4ec1aaf4a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.987034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29c68-3717-4ba9-904c-29f02bf77421 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:48.988074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df246-c76f-4da3-8f15-926b286f9761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.988667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df246-c76f-4da3-8f15-926b286f9761 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.988941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df246-c76f-4da3-8f15-926b286f9761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.989208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df246-c76f-4da3-8f15-926b286f9761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.989829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35df246-c76f-4da3-8f15-926b286f9761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.991751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1882ad-1e5f-4505-a046-01101d3a4526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:48.991890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35df246-c76f-4da3-8f15-926b286f9761 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:48.992338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1882ad-1e5f-4505-a046-01101d3a4526 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:48.992620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1882ad-1e5f-4505-a046-01101d3a4526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:48.992894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1882ad-1e5f-4505-a046-01101d3a4526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:48.993530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1882ad-1e5f-4505-a046-01101d3a4526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:48.995293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1882ad-1e5f-4505-a046-01101d3a4526 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.005755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 788/1571] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.006606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1882ad-1e5f-4505-a046-01101d3a4526 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.017331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1882ad-1e5f-4505-a046-01101d3a4526 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.022115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5bdd5-07a3-4dfc-b653-f5b79089d068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.022699 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5bdd5-07a3-4dfc-b653-f5b79089d068 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.023004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5bdd5-07a3-4dfc-b653-f5b79089d068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.023271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5bdd5-07a3-4dfc-b653-f5b79089d068 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.023889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5bdd5-07a3-4dfc-b653-f5b79089d068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.027867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 784/1572] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:48 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.027867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df246-c76f-4da3-8f15-926b286f9761 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.028108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5bdd5-07a3-4dfc-b653-f5b79089d068 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.047904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 789/1573] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/users => generated 282 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.051795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5bdd5-07a3-4dfc-b653-f5b79089d068 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.061980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5bdd5-07a3-4dfc-b653-f5b79089d068 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.065682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:49.077338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:49.092651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df246-c76f-4da3-8f15-926b286f9761 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.097287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.097878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.098152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.098423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.099116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:49.099437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.101014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.113884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 785/1574] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:00:49.114664 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.122942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.123599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.123868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.124130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] PATH_INFO: `/v3/projects/b3f6f03cfd69410eb7a4dbefca1f95d4/users/cd5ac67dae69446eb8695af69daa439f/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.125109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117faaf-eeee-4ca1-a1fd-011047a060e6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.130018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141e2e9-b92d-4ec6-ab48-04eca65bf270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.130607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141e2e9-b92d-4ec6-ab48-04eca65bf270 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.130927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141e2e9-b92d-4ec6-ab48-04eca65bf270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.131185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141e2e9-b92d-4ec6-ab48-04eca65bf270 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.132064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141e2e9-b92d-4ec6-ab48-04eca65bf270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.134721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141e2e9-b92d-4ec6-ab48-04eca65bf270 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.139101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f6f03cfd69410eb7a4dbefca1f95d4, user_id=cd5ac67dae69446eb8695af69daa439f, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.140150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 05:00:49.140150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: warnings.warn(msg) Sep 24 05:00:49.140150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: Sep 24 05:00:49.142072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.160687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 786/1575] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.161048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 790/1576] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:49 2022] PUT /identity/v3/projects/b3f6f03cfd69410eb7a4dbefca1f95d4/users/cd5ac67dae69446eb8695af69daa439f/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:49.161202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141e2e9-b92d-4ec6-ab48-04eca65bf270 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.161304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.171201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141e2e9-b92d-4ec6-ab48-04eca65bf270 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.223348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730f197-e295-4324-a850-c787b4f4ee49 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.225244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e186e-8dfe-4d46-8308-395c2ef332f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.225845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e186e-8dfe-4d46-8308-395c2ef332f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.226120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e186e-8dfe-4d46-8308-395c2ef332f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.226389 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e186e-8dfe-4d46-8308-395c2ef332f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.227045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e186e-8dfe-4d46-8308-395c2ef332f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.228637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697e696-9e6d-4614-8ab6-98dbcd139a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.229234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697e696-9e6d-4614-8ab6-98dbcd139a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.229506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697e696-9e6d-4614-8ab6-98dbcd139a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.229617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e186e-8dfe-4d46-8308-395c2ef332f4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.229773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697e696-9e6d-4614-8ab6-98dbcd139a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.230393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697e696-9e6d-4614-8ab6-98dbcd139a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.232367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697e696-9e6d-4614-8ab6-98dbcd139a3a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.261366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 787/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.261366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e186e-8dfe-4d46-8308-395c2ef332f4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.261689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 791/1578] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.261689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697e696-9e6d-4614-8ab6-98dbcd139a3a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.320952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e186e-8dfe-4d46-8308-395c2ef332f4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.323505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697e696-9e6d-4614-8ab6-98dbcd139a3a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.325561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28ac27-ee49-493c-a268-4e3ec81d2821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.326155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28ac27-ee49-493c-a268-4e3ec81d2821 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.326431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28ac27-ee49-493c-a268-4e3ec81d2821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.326704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28ac27-ee49-493c-a268-4e3ec81d2821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.327376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28ac27-ee49-493c-a268-4e3ec81d2821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.328298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b206ae8-9110-463b-90f2-e1452fbf6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.328889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206ae8-9110-463b-90f2-e1452fbf6efd admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.329001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28ac27-ee49-493c-a268-4e3ec81d2821 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.329242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206ae8-9110-463b-90f2-e1452fbf6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.329525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206ae8-9110-463b-90f2-e1452fbf6efd admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.330153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b206ae8-9110-463b-90f2-e1452fbf6efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.332069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b206ae8-9110-463b-90f2-e1452fbf6efd admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.339427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 788/1579] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.340222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28ac27-ee49-493c-a268-4e3ec81d2821 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.349785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28ac27-ee49-493c-a268-4e3ec81d2821 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.355504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7372-04dc-44b7-8f35-2a02c715d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.356108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7372-04dc-44b7-8f35-2a02c715d123 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.356467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7372-04dc-44b7-8f35-2a02c715d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.356827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7372-04dc-44b7-8f35-2a02c715d123 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.357556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d7372-04dc-44b7-8f35-2a02c715d123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.358500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 792/1580] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.359246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d7372-04dc-44b7-8f35-2a02c715d123 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.359369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b206ae8-9110-463b-90f2-e1452fbf6efd admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.365591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:49.369961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b206ae8-9110-463b-90f2-e1452fbf6efd admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.370114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 789/1581] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.370772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7372-04dc-44b7-8f35-2a02c715d123 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.376417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37582d7-9488-4b52-ab71-78f377b94d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.377241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37582d7-9488-4b52-ab71-78f377b94d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.377692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37582d7-9488-4b52-ab71-78f377b94d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.378123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37582d7-9488-4b52-ab71-78f377b94d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.379099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37582d7-9488-4b52-ab71-78f377b94d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.380650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7372-04dc-44b7-8f35-2a02c715d123 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.381102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37582d7-9488-4b52-ab71-78f377b94d2b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.385562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa45a4b-247d-4b13-b96f-2f0266234aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.386143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45a4b-247d-4b13-b96f-2f0266234aea admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.386419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45a4b-247d-4b13-b96f-2f0266234aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.386709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45a4b-247d-4b13-b96f-2f0266234aea admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.387356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45a4b-247d-4b13-b96f-2f0266234aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.388920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45a4b-247d-4b13-b96f-2f0266234aea admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.399307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 790/1582] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.401415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d070dd-0a0d-4766-9c0a-90f7ce76ad22 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.401698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d070dd-0a0d-4766-9c0a-90f7ce76ad22 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.401970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d070dd-0a0d-4766-9c0a-90f7ce76ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.416264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 793/1583] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.416264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37582d7-9488-4b52-ab71-78f377b94d2b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.421446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-57d070dd-0a0d-4766-9c0a-90f7ce76ad22 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:49.422642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-57d070dd-0a0d-4766-9c0a-90f7ce76ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:49.440810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:49.480413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37582d7-9488-4b52-ab71-78f377b94d2b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.483465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 791/1584] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:49.484433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d070dd-0a0d-4766-9c0a-90f7ce76ad22 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.488852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb0e7-6769-4c1b-8ed3-f51a3546ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.489464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb0e7-6769-4c1b-8ed3-f51a3546ec27 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.489745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb0e7-6769-4c1b-8ed3-f51a3546ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.490015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb0e7-6769-4c1b-8ed3-f51a3546ec27 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.490651 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb0e7-6769-4c1b-8ed3-f51a3546ec27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.492602 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb0e7-6769-4c1b-8ed3-f51a3546ec27 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.493939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d070dd-0a0d-4766-9c0a-90f7ce76ad22 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.498546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d3ae1-53dc-4680-82ba-2dde4b5d31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.499165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d3ae1-53dc-4680-82ba-2dde4b5d31b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.499445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d3ae1-53dc-4680-82ba-2dde4b5d31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.499713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d3ae1-53dc-4680-82ba-2dde4b5d31b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.500335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d3ae1-53dc-4680-82ba-2dde4b5d31b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.502230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d3ae1-53dc-4680-82ba-2dde4b5d31b3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.514358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 794/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.515182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb0e7-6769-4c1b-8ed3-f51a3546ec27 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.525063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb0e7-6769-4c1b-8ed3-f51a3546ec27 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.527361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 792/1586] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.528176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d3ae1-53dc-4680-82ba-2dde4b5d31b3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.532715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041290c-66d7-4577-9b60-276a0b0c864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.533547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041290c-66d7-4577-9b60-276a0b0c864d admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.534318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041290c-66d7-4577-9b60-276a0b0c864d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.534318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041290c-66d7-4577-9b60-276a0b0c864d admin admin] PATH_INFO: `/v3/projects/e20292bdd4ff41abac0d68af448b931e/users/c980e06949dc4b8e9552600235c146b6/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.537534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d3ae1-53dc-4680-82ba-2dde4b5d31b3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.543481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d91e4-1967-44df-a35f-aef79bbf7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.544066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d91e4-1967-44df-a35f-aef79bbf7aae admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.544341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d91e4-1967-44df-a35f-aef79bbf7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.544714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d91e4-1967-44df-a35f-aef79bbf7aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.545276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d91e4-1967-44df-a35f-aef79bbf7aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.547056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d91e4-1967-44df-a35f-aef79bbf7aae admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.549567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041290c-66d7-4577-9b60-276a0b0c864d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20292bdd4ff41abac0d68af448b931e, user_id=c980e06949dc4b8e9552600235c146b6, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.552258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041290c-66d7-4577-9b60-276a0b0c864d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.557441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 793/1587] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.558199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d91e4-1967-44df-a35f-aef79bbf7aae admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.567505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 795/1588] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:49 2022] PUT /identity/v3/projects/e20292bdd4ff41abac0d68af448b931e/users/c980e06949dc4b8e9552600235c146b6/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:49.579289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d91e4-1967-44df-a35f-aef79bbf7aae admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.579435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041290c-66d7-4577-9b60-276a0b0c864d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.625776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c46ae-55b9-443a-82b0-008089a2399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.626381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c46ae-55b9-443a-82b0-008089a2399a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.626662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c46ae-55b9-443a-82b0-008089a2399a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.626966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c46ae-55b9-443a-82b0-008089a2399a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.627603 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c46ae-55b9-443a-82b0-008089a2399a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.629184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c46ae-55b9-443a-82b0-008089a2399a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.640023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 794/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.640888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c46ae-55b9-443a-82b0-008089a2399a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.641826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041290c-66d7-4577-9b60-276a0b0c864d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.651326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c46ae-55b9-443a-82b0-008089a2399a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.653190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb3889-4d7a-41ba-a7fa-dcb7edfdddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.653812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb3889-4d7a-41ba-a7fa-dcb7edfdddde admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.654219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb3889-4d7a-41ba-a7fa-dcb7edfdddde admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.654491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb3889-4d7a-41ba-a7fa-dcb7edfdddde admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.655201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb3889-4d7a-41ba-a7fa-dcb7edfdddde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.656233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678de8f-b83f-4114-85e9-d19e5c91a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.656816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb3889-4d7a-41ba-a7fa-dcb7edfdddde admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.656980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678de8f-b83f-4114-85e9-d19e5c91a939 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.657080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678de8f-b83f-4114-85e9-d19e5c91a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.657353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678de8f-b83f-4114-85e9-d19e5c91a939 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.658056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678de8f-b83f-4114-85e9-d19e5c91a939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.659974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678de8f-b83f-4114-85e9-d19e5c91a939 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.668588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 796/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.669748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb3889-4d7a-41ba-a7fa-dcb7edfdddde admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.686345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 795/1591] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/users => generated 301 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:49.687275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678de8f-b83f-4114-85e9-d19e5c91a939 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.697250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678de8f-b83f-4114-85e9-d19e5c91a939 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.702155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aad18a-7d57-41d3-8ef3-246f741331a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.702776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aad18a-7d57-41d3-8ef3-246f741331a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.703063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aad18a-7d57-41d3-8ef3-246f741331a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.703328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aad18a-7d57-41d3-8ef3-246f741331a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.703952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aad18a-7d57-41d3-8ef3-246f741331a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.705545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aad18a-7d57-41d3-8ef3-246f741331a2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.716464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 796/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.717260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aad18a-7d57-41d3-8ef3-246f741331a2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.719246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:49.727495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aad18a-7d57-41d3-8ef3-246f741331a2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.730240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb3889-4d7a-41ba-a7fa-dcb7edfdddde admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.732904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5071ed-f45b-41b7-b864-90e8452080ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.733479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5071ed-f45b-41b7-b864-90e8452080ce admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.733749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5071ed-f45b-41b7-b864-90e8452080ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.733867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924207f-ba3e-4140-9907-1b7d96f66448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.734016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5071ed-f45b-41b7-b864-90e8452080ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.734557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924207f-ba3e-4140-9907-1b7d96f66448 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.734684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5071ed-f45b-41b7-b864-90e8452080ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.734862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924207f-ba3e-4140-9907-1b7d96f66448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.735135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924207f-ba3e-4140-9907-1b7d96f66448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.736291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5071ed-f45b-41b7-b864-90e8452080ce admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.745820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924207f-ba3e-4140-9907-1b7d96f66448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.747286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924207f-ba3e-4140-9907-1b7d96f66448 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.750830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 797/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.750830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5071ed-f45b-41b7-b864-90e8452080ce admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.757404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 797/1594] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:49.758381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5071ed-f45b-41b7-b864-90e8452080ce admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.758608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2f36-2b84-4e0d-a3cd-011487ba890b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.759042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2f36-2b84-4e0d-a3cd-011487ba890b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.759279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2f36-2b84-4e0d-a3cd-011487ba890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.763126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec876-c1cd-4d11-8d60-d8b30f2a6583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.763718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec876-c1cd-4d11-8d60-d8b30f2a6583 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.763990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec876-c1cd-4d11-8d60-d8b30f2a6583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.764256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec876-c1cd-4d11-8d60-d8b30f2a6583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.764908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec876-c1cd-4d11-8d60-d8b30f2a6583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.766474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec876-c1cd-4d11-8d60-d8b30f2a6583 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.779669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 798/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.780793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec876-c1cd-4d11-8d60-d8b30f2a6583 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.789806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a6ba2f36-2b84-4e0d-a3cd-011487ba890b None None] MFA Rules not processed for user `c980e06949dc4b8e9552600235c146b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:49.791960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a6ba2f36-2b84-4e0d-a3cd-011487ba890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:49.792928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec876-c1cd-4d11-8d60-d8b30f2a6583 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.798498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092d19-dd3e-4e98-ab5c-e866cff10f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.799017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092d19-dd3e-4e98-ab5c-e866cff10f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.799290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092d19-dd3e-4e98-ab5c-e866cff10f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.799556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092d19-dd3e-4e98-ab5c-e866cff10f57 admin admin] PATH_INFO: `/v3/projects/898d8a291ffa4d3284fa0124b594fd64/users/c105db01ffe5467e88aeaa17ab54dcac/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.817223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99092d19-dd3e-4e98-ab5c-e866cff10f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898d8a291ffa4d3284fa0124b594fd64, user_id=c105db01ffe5467e88aeaa17ab54dcac, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.819910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99092d19-dd3e-4e98-ab5c-e866cff10f57 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.834658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 799/1596] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:49 2022] PUT /identity/v3/projects/898d8a291ffa4d3284fa0124b594fd64/users/c105db01ffe5467e88aeaa17ab54dcac/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:49.835437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092d19-dd3e-4e98-ab5c-e866cff10f57 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.857352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:49.879144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 798/1597] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:49.880283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2f36-2b84-4e0d-a3cd-011487ba890b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.894450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2f36-2b84-4e0d-a3cd-011487ba890b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.918443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092d19-dd3e-4e98-ab5c-e866cff10f57 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:49.924261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd42be-5478-420f-adc2-2cf9d64df664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.927743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd42be-5478-420f-adc2-2cf9d64df664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.927942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd42be-5478-420f-adc2-2cf9d64df664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.928375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd42be-5478-420f-adc2-2cf9d64df664 admin admin] PATH_INFO: `/v3/projects/61f314a18b2345da9891f07575f1e343/users/cc5fd47f13c54854995e28ec01ad6e0e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.950025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd42be-5478-420f-adc2-2cf9d64df664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f314a18b2345da9891f07575f1e343, user_id=cc5fd47f13c54854995e28ec01ad6e0e, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.953305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd42be-5478-420f-adc2-2cf9d64df664 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.969178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878a285-a553-4191-b9fc-579a67b80f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:49.970404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a285-a553-4191-b9fc-579a67b80f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:49.971122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 800/1598] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:49 2022] PUT /identity/v3/projects/61f314a18b2345da9891f07575f1e343/users/cc5fd47f13c54854995e28ec01ad6e0e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:49.971412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a285-a553-4191-b9fc-579a67b80f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:49.971868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a285-a553-4191-b9fc-579a67b80f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:49.972697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878a285-a553-4191-b9fc-579a67b80f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:49.974504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878a285-a553-4191-b9fc-579a67b80f8c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:49.975808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd42be-5478-420f-adc2-2cf9d64df664 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:49.986852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 799/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:49.988587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878a285-a553-4191-b9fc-579a67b80f8c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.003371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878a285-a553-4191-b9fc-579a67b80f8c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.071854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36f960-10f3-45c1-a680-a7db4cbe4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.072904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36f960-10f3-45c1-a680-a7db4cbe4370 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.073189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36f960-10f3-45c1-a680-a7db4cbe4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.073488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36f960-10f3-45c1-a680-a7db4cbe4370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.074199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36f960-10f3-45c1-a680-a7db4cbe4370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:50.075903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36f960-10f3-45c1-a680-a7db4cbe4370 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:50.076954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd42be-5478-420f-adc2-2cf9d64df664 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.085831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9028b-3e5a-46b8-94ab-9db466a0705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.086487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9028b-3e5a-46b8-94ab-9db466a0705f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.086716 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9028b-3e5a-46b8-94ab-9db466a0705f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.091175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9028b-3e5a-46b8-94ab-9db466a0705f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.091347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 800/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:50.091438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9028b-3e5a-46b8-94ab-9db466a0705f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:50.091537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36f960-10f3-45c1-a680-a7db4cbe4370 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.091624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9028b-3e5a-46b8-94ab-9db466a0705f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:50.104258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36f960-10f3-45c1-a680-a7db4cbe4370 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.105158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 801/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:50.106215 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43044-0410-45f4-b8cc-6fd9c0bd325b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.106497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43044-0410-45f4-b8cc-6fd9c0bd325b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.106811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43044-0410-45f4-b8cc-6fd9c0bd325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.111817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462525e-ba00-4e52-88e8-b24fffbb3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.113419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462525e-ba00-4e52-88e8-b24fffbb3864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.114181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462525e-ba00-4e52-88e8-b24fffbb3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.114703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462525e-ba00-4e52-88e8-b24fffbb3864 admin admin] PATH_INFO: `/v3/projects/c282ec454ba64329ba7031fc1f90db20/users/af82c99ccd584433bdff0b6ba2499ba4/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.118825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:50.134640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462525e-ba00-4e52-88e8-b24fffbb3864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c282ec454ba64329ba7031fc1f90db20, user_id=af82c99ccd584433bdff0b6ba2499ba4, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:50.137721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462525e-ba00-4e52-88e8-b24fffbb3864 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:50.142737 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-71d43044-0410-45f4-b8cc-6fd9c0bd325b None None] MFA Rules not processed for user `c105db01ffe5467e88aeaa17ab54dcac`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:50.145034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-71d43044-0410-45f4-b8cc-6fd9c0bd325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:50.158302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 801/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:50 2022] PUT /identity/v3/projects/c282ec454ba64329ba7031fc1f90db20/users/af82c99ccd584433bdff0b6ba2499ba4/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:50.159729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee62b-4968-4fcf-86e5-e15e992416e5 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.160017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee62b-4968-4fcf-86e5-e15e992416e5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.160286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee62b-4968-4fcf-86e5-e15e992416e5 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.161861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 802/1603] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 24 05:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:00:50.163545 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e512e-205d-4070-8c6b-ebf3e5bb221b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.163963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e512e-205d-4070-8c6b-ebf3e5bb221b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.164245 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e512e-205d-4070-8c6b-ebf3e5bb221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.202674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bc8e512e-205d-4070-8c6b-ebf3e5bb221b None None] MFA Rules not processed for user `cc5fd47f13c54854995e28ec01ad6e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:50.204507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bc8e512e-205d-4070-8c6b-ebf3e5bb221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:50.282923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 802/1604] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:50.282923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43044-0410-45f4-b8cc-6fd9c0bd325b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.296342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43044-0410-45f4-b8cc-6fd9c0bd325b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.313152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 803/1605] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:50.314013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e512e-205d-4070-8c6b-ebf3e5bb221b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.337945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:50.389226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552edcbc-db91-4076-aaa4-f1297e6c2c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.389980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552edcbc-db91-4076-aaa4-f1297e6c2c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.390256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552edcbc-db91-4076-aaa4-f1297e6c2c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.390542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552edcbc-db91-4076-aaa4-f1297e6c2c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.391403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552edcbc-db91-4076-aaa4-f1297e6c2c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:50.393353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552edcbc-db91-4076-aaa4-f1297e6c2c52 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:50.393848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e512e-205d-4070-8c6b-ebf3e5bb221b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.399673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a7d66-7b6a-4881-a9fc-5161033299d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.400732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a7d66-7b6a-4881-a9fc-5161033299d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.401181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a7d66-7b6a-4881-a9fc-5161033299d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.402327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a7d66-7b6a-4881-a9fc-5161033299d2 admin admin] PATH_INFO: `/v3/projects/08ef3fedfe424355ab19e0b5011a9922/users/e5cce01c978f43029c17fd696e1a2bc3/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.404291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 803/1606] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:50.410060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552edcbc-db91-4076-aaa4-f1297e6c2c52 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.421952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552edcbc-db91-4076-aaa4-f1297e6c2c52 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.425807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a7d66-7b6a-4881-a9fc-5161033299d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ef3fedfe424355ab19e0b5011a9922, user_id=e5cce01c978f43029c17fd696e1a2bc3, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:50.427231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c80f6-d7e0-451a-b809-8e48a9a6fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.427940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c80f6-d7e0-451a-b809-8e48a9a6fc25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.428190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c80f6-d7e0-451a-b809-8e48a9a6fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.428458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c80f6-d7e0-451a-b809-8e48a9a6fc25 admin admin] PATH_INFO: `/v3/projects/cc5b10c7cdf944cdbe343e21c7286a66/users/e7b6010b22e24c3a9f4bbda08e3eb643/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.429271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a7d66-7b6a-4881-a9fc-5161033299d2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:50.446003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c80f6-d7e0-451a-b809-8e48a9a6fc25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5b10c7cdf944cdbe343e21c7286a66, user_id=e7b6010b22e24c3a9f4bbda08e3eb643, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:50.448601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 804/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:50 2022] PUT /identity/v3/projects/08ef3fedfe424355ab19e0b5011a9922/users/e5cce01c978f43029c17fd696e1a2bc3/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:50.448856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c80f6-d7e0-451a-b809-8e48a9a6fc25 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:50.453585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dbb50-cf5b-4cd7-9498-8e79ae6de1b8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.454239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dbb50-cf5b-4cd7-9498-8e79ae6de1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.454437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dbb50-cf5b-4cd7-9498-8e79ae6de1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.477142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 804/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:50 2022] PUT /identity/v3/projects/cc5b10c7cdf944cdbe343e21c7286a66/users/e7b6010b22e24c3a9f4bbda08e3eb643/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:50.477142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deef80-9c55-497c-a574-0f411d9736d3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.477142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deef80-9c55-497c-a574-0f411d9736d3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.477142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deef80-9c55-497c-a574-0f411d9736d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.478289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a71dbb50-cf5b-4cd7-9498-8e79ae6de1b8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:50.478289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a71dbb50-cf5b-4cd7-9498-8e79ae6de1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:50.528324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-32deef80-9c55-497c-a574-0f411d9736d3 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:50.529542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-32deef80-9c55-497c-a574-0f411d9736d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:50.549261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:50.563080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 805/1609] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:50.564304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dbb50-cf5b-4cd7-9498-8e79ae6de1b8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.578269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dbb50-cf5b-4cd7-9498-8e79ae6de1b8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.593829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5ec3e-7833-4f7b-849e-9e42fa0e9001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.594468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ec3e-7833-4f7b-849e-9e42fa0e9001 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.594767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ec3e-7833-4f7b-849e-9e42fa0e9001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.595042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ec3e-7833-4f7b-849e-9e42fa0e9001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.597960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5ec3e-7833-4f7b-849e-9e42fa0e9001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:50.601016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5ec3e-7833-4f7b-849e-9e42fa0e9001 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:50.651026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 806/1610] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:50 2022] POST /identity/v3/projects => generated 363 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:50.652205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2f7c-c9aa-4637-be53-161d12caeeae None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.652597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2f7c-c9aa-4637-be53-161d12caeeae None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.652874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2f7c-c9aa-4637-be53-161d12caeeae None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.655058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 805/1611] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 24 05:00:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:50.655865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 807/1612] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 24 05:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:00:50.656642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32deef80-9c55-497c-a574-0f411d9736d3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.657701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d209ef-a15b-4bad-b78a-f8d1c368c9b1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.658217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d209ef-a15b-4bad-b78a-f8d1c368c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.658697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d209ef-a15b-4bad-b78a-f8d1c368c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.672567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32deef80-9c55-497c-a574-0f411d9736d3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.685878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-35d209ef-a15b-4bad-b78a-f8d1c368c9b1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:50.687463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-35d209ef-a15b-4bad-b78a-f8d1c368c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:50.766576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.768214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.768742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.769233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] PATH_INFO: `/v3/projects/6847706aa4b04fe8948bd81dd4cd9a03/users/234e374459f54ae89898c834f4d65071/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.780151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 808/1613] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:50.782396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaf413-37bd-4913-b0f2-fae63208090a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.782876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaf413-37bd-4913-b0f2-fae63208090a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.784681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaf413-37bd-4913-b0f2-fae63208090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:50.795877 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6847706aa4b04fe8948bd81dd4cd9a03, user_id=234e374459f54ae89898c834f4d65071, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:50.799895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:50.816179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:50.826244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 806/1614] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:50 2022] PUT /identity/v3/projects/6847706aa4b04fe8948bd81dd4cd9a03/users/234e374459f54ae89898c834f4d65071/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:50.827474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.827808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7ceaf413-37bd-4913-b0f2-fae63208090a None None] MFA Rules not processed for user `e7b6010b22e24c3a9f4bbda08e3eb643`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:50.829203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7ceaf413-37bd-4913-b0f2-fae63208090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:50.832157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:50.922812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282e15a-5ecc-4c92-954d-1b2265235514 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:50.927054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 809/1615] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:50.927228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd98199-5a90-4550-ab7e-16d40c329c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:50.927967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98199-5a90-4550-ab7e-16d40c329c59 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:50.928287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaf413-37bd-4913-b0f2-fae63208090a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:50.928440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98199-5a90-4550-ab7e-16d40c329c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:50.928724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98199-5a90-4550-ab7e-16d40c329c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.007230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd98199-5a90-4550-ab7e-16d40c329c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.009457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd98199-5a90-4550-ab7e-16d40c329c59 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.012146 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaf413-37bd-4913-b0f2-fae63208090a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.018731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cda72f-331f-436a-8ac2-dd88e7bb508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.019520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cda72f-331f-436a-8ac2-dd88e7bb508f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.019897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cda72f-331f-436a-8ac2-dd88e7bb508f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.020263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cda72f-331f-436a-8ac2-dd88e7bb508f admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.021061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cda72f-331f-436a-8ac2-dd88e7bb508f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.022815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 807/1616] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:51.023771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cda72f-331f-436a-8ac2-dd88e7bb508f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.024450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10e94c-0029-4159-a00b-5b906d949965 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.025442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10e94c-0029-4159-a00b-5b906d949965 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.025860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10e94c-0029-4159-a00b-5b906d949965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.041149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:51.047621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8d10e94c-0029-4159-a00b-5b906d949965 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:51.048772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d10e94c-0029-4159-a00b-5b906d949965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:51.062718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 810/1617] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:50 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:51.063915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cda72f-331f-436a-8ac2-dd88e7bb508f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.164353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 808/1618] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 24 05:00:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:51.165535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10e94c-0029-4159-a00b-5b906d949965 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.168286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cda72f-331f-436a-8ac2-dd88e7bb508f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.177432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10e94c-0029-4159-a00b-5b906d949965 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.180241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7806-1eca-4a16-8c44-a8650bd3a079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.181775 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7806-1eca-4a16-8c44-a8650bd3a079 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.182005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be810f16-96b0-403f-9865-82104e034b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.182725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be810f16-96b0-403f-9865-82104e034b5f service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.183526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7806-1eca-4a16-8c44-a8650bd3a079 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.183526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7806-1eca-4a16-8c44-a8650bd3a079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.195698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be810f16-96b0-403f-9865-82104e034b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.196240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be810f16-96b0-403f-9865-82104e034b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.213170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be810f16-96b0-403f-9865-82104e034b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.218135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be810f16-96b0-403f-9865-82104e034b5f service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.230638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 809/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:51.232778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e9f0-583a-476c-be11-338f3a4ade54 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.233270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e9f0-583a-476c-be11-338f3a4ade54 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.233738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e9f0-583a-476c-be11-338f3a4ade54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.268760 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b263e9f0-583a-476c-be11-338f3a4ade54 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:51.271047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b263e9f0-583a-476c-be11-338f3a4ade54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:51.284598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 810/1620] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:51.285886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263e9f0-583a-476c-be11-338f3a4ade54 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.298788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263e9f0-583a-476c-be11-338f3a4ade54 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.304841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2b458-7208-4480-8e20-8675782507cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.307290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b458-7208-4480-8e20-8675782507cc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.307531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b458-7208-4480-8e20-8675782507cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.307795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b458-7208-4480-8e20-8675782507cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.309852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2b458-7208-4480-8e20-8675782507cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.314806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2b458-7208-4480-8e20-8675782507cc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.343508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7806-1eca-4a16-8c44-a8650bd3a079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.345643 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7806-1eca-4a16-8c44-a8650bd3a079 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.354343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:51.373752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 811/1621] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:51 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:51.374629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2b458-7208-4480-8e20-8675782507cc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.375079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 811/1622] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:51.376543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7806-1eca-4a16-8c44-a8650bd3a079 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.392162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7806-1eca-4a16-8c44-a8650bd3a079 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.490574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048da66-99dc-4520-bd2f-c396fc6474b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.491404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048da66-99dc-4520-bd2f-c396fc6474b0 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.499677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048da66-99dc-4520-bd2f-c396fc6474b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.501760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048da66-99dc-4520-bd2f-c396fc6474b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.518147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2b458-7208-4480-8e20-8675782507cc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.530169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f4b9f-38a4-4123-a519-e8d2092b9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.530818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f4b9f-38a4-4123-a519-e8d2092b9f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.531160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f4b9f-38a4-4123-a519-e8d2092b9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.531369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f4b9f-38a4-4123-a519-e8d2092b9f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.532013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f4b9f-38a4-4123-a519-e8d2092b9f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.543214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f4b9f-38a4-4123-a519-e8d2092b9f4f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.566424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 812/1623] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:51.567328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f4b9f-38a4-4123-a519-e8d2092b9f4f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.573132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:51.607719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048da66-99dc-4520-bd2f-c396fc6474b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.609628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048da66-99dc-4520-bd2f-c396fc6474b0 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.635529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 812/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:51.636866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048da66-99dc-4520-bd2f-c396fc6474b0 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.677585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048da66-99dc-4520-bd2f-c396fc6474b0 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.693484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bffce5-c78a-4576-ab0b-dfb1f4f0c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.695702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bffce5-c78a-4576-ab0b-dfb1f4f0c8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.695981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bffce5-c78a-4576-ab0b-dfb1f4f0c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.697804 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bffce5-c78a-4576-ab0b-dfb1f4f0c8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.698476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bffce5-c78a-4576-ab0b-dfb1f4f0c8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.703213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bffce5-c78a-4576-ab0b-dfb1f4f0c8a1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.725843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f4b9f-38a4-4123-a519-e8d2092b9f4f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.732494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd9603-1dbe-444f-8cf5-f174bc9436aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.733178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd9603-1dbe-444f-8cf5-f174bc9436aa service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.733517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd9603-1dbe-444f-8cf5-f174bc9436aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.733797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd9603-1dbe-444f-8cf5-f174bc9436aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.752649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 813/1625] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:51 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:51.754576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bffce5-c78a-4576-ab0b-dfb1f4f0c8a1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.765002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd9603-1dbe-444f-8cf5-f174bc9436aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.766551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd9603-1dbe-444f-8cf5-f174bc9436aa service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.876675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 813/1626] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:51.876675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd9603-1dbe-444f-8cf5-f174bc9436aa service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.885353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bffce5-c78a-4576-ab0b-dfb1f4f0c8a1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.887203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd9603-1dbe-444f-8cf5-f174bc9436aa service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.888477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424b00-afc2-4837-9d3c-f96c9412bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.888477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424b00-afc2-4837-9d3c-f96c9412bf4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.888477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424b00-afc2-4837-9d3c-f96c9412bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.888477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424b00-afc2-4837-9d3c-f96c9412bf4d admin admin] PATH_INFO: `/v3/projects/7c1c618ffa404247bd5818c033826fc0/users/7b9f793b40a4482d9f01bfbd63b79ac9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.889371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd252fe6-ee4c-42f4-aea0-d3cee9f0c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.889371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd252fe6-ee4c-42f4-aea0-d3cee9f0c332 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.889371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd252fe6-ee4c-42f4-aea0-d3cee9f0c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.889371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd252fe6-ee4c-42f4-aea0-d3cee9f0c332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.891853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd252fe6-ee4c-42f4-aea0-d3cee9f0c332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.891853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd252fe6-ee4c-42f4-aea0-d3cee9f0c332 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.899882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 814/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:51.907104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd252fe6-ee4c-42f4-aea0-d3cee9f0c332 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.915138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd252fe6-ee4c-42f4-aea0-d3cee9f0c332 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:51.920520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10424b00-afc2-4837-9d3c-f96c9412bf4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c618ffa404247bd5818c033826fc0, user_id=7b9f793b40a4482d9f01bfbd63b79ac9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.923767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10424b00-afc2-4837-9d3c-f96c9412bf4d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:51.931567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687a60-9207-4137-9063-8970f887dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:51.932245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687a60-9207-4137-9063-8970f887dcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:51.932523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687a60-9207-4137-9063-8970f887dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:51.932801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687a60-9207-4137-9063-8970f887dcb8 admin admin] PATH_INFO: `/v3/projects/0d8fc56ec06848a994bba8d954cb7b15/users/0dd6e49c9f0a42d892b98cbc328dd195/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:51.946372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 814/1628] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:51 2022] PUT /identity/v3/projects/7c1c618ffa404247bd5818c033826fc0/users/7b9f793b40a4482d9f01bfbd63b79ac9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:51.951496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424b00-afc2-4837-9d3c-f96c9412bf4d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:51.964929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52687a60-9207-4137-9063-8970f887dcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8fc56ec06848a994bba8d954cb7b15, user_id=0dd6e49c9f0a42d892b98cbc328dd195, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:51.967623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52687a60-9207-4137-9063-8970f887dcb8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:52.000194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 815/1629] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:51 2022] PUT /identity/v3/projects/0d8fc56ec06848a994bba8d954cb7b15/users/0dd6e49c9f0a42d892b98cbc328dd195/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:52.000194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b68d5-92c0-480e-99fd-0938cd83e0cb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.000194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b68d5-92c0-480e-99fd-0938cd83e0cb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.000194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b68d5-92c0-480e-99fd-0938cd83e0cb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.000867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 816/1630] 10.222.0.26 () {54 vars in 912 bytes} [Sat Sep 24 05:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:00:52.015181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b68d5-92c0-480e-99fd-0938cd83e0cb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:52.108137 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424b00-afc2-4837-9d3c-f96c9412bf4d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:52.147234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b68d5-92c0-480e-99fd-0938cd83e0cb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:52.165080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd92e69-f484-4861-947e-90ee31861b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:52.166130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd92e69-f484-4861-947e-90ee31861b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.166130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd92e69-f484-4861-947e-90ee31861b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.166976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd92e69-f484-4861-947e-90ee31861b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.167108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd92e69-f484-4861-947e-90ee31861b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:52.168662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd92e69-f484-4861-947e-90ee31861b12 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:52.177651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:52.191725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 817/1631] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:52.193016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2899e7-1e35-4312-8204-73d2995626d4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.193295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2899e7-1e35-4312-8204-73d2995626d4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.193566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2899e7-1e35-4312-8204-73d2995626d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.230806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1427e6-1baf-4cc6-98f8-d6c528846532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:52.231417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7c2899e7-1e35-4312-8204-73d2995626d4 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:52.232250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7c2899e7-1e35-4312-8204-73d2995626d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:52.232509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1427e6-1baf-4cc6-98f8-d6c528846532 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.233218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1427e6-1baf-4cc6-98f8-d6c528846532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.234072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1427e6-1baf-4cc6-98f8-d6c528846532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.235471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1427e6-1baf-4cc6-98f8-d6c528846532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:52.237718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1427e6-1baf-4cc6-98f8-d6c528846532 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:52.253643 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 815/1632] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:52.255625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1427e6-1baf-4cc6-98f8-d6c528846532 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:52.277346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1427e6-1baf-4cc6-98f8-d6c528846532 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:52.283464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1df69-7572-45de-ab62-8792749c3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:52.284303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1df69-7572-45de-ab62-8792749c3201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.284588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1df69-7572-45de-ab62-8792749c3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.285023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1df69-7572-45de-ab62-8792749c3201 admin admin] PATH_INFO: `/v3/projects/0d8fc56ec06848a994bba8d954cb7b15/users/0dd6e49c9f0a42d892b98cbc328dd195/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.288314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1df69-7572-45de-ab62-8792749c3201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8fc56ec06848a994bba8d954cb7b15, user_id=0dd6e49c9f0a42d892b98cbc328dd195, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:52.293343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1df69-7572-45de-ab62-8792749c3201 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:52.308580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 816/1633] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:52 2022] PUT /identity/v3/projects/0d8fc56ec06848a994bba8d954cb7b15/users/0dd6e49c9f0a42d892b98cbc328dd195/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:52.309854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f9c0e-0c22-4782-999a-7a426b5bab17 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.310134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f9c0e-0c22-4782-999a-7a426b5bab17 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.310417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f9c0e-0c22-4782-999a-7a426b5bab17 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.312091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 817/1634] 10.222.0.26 () {54 vars in 912 bytes} [Sat Sep 24 05:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:00:52.312924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f9c0e-0c22-4782-999a-7a426b5bab17 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:52.339653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 818/1635] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:52.341143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b000b-3e42-472f-972b-70e467811705 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.341514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b000b-3e42-472f-972b-70e467811705 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.341789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b000b-3e42-472f-972b-70e467811705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.347734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:52.376823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-010b000b-3e42-472f-972b-70e467811705 None None] MFA Rules not processed for user `0dd6e49c9f0a42d892b98cbc328dd195`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:52.378995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-010b000b-3e42-472f-972b-70e467811705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:52.431440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f9c0e-0c22-4782-999a-7a426b5bab17 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:52.437862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa585ebc-e96e-4e44-8167-4870feb8c725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:52.439142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585ebc-e96e-4e44-8167-4870feb8c725 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.439487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585ebc-e96e-4e44-8167-4870feb8c725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.439767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585ebc-e96e-4e44-8167-4870feb8c725 admin admin] PATH_INFO: `/v3/projects/7c1c618ffa404247bd5818c033826fc0/users/7b9f793b40a4482d9f01bfbd63b79ac9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.442962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa585ebc-e96e-4e44-8167-4870feb8c725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c618ffa404247bd5818c033826fc0, user_id=7b9f793b40a4482d9f01bfbd63b79ac9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:52.445946 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa585ebc-e96e-4e44-8167-4870feb8c725 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:52.462109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 818/1636] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:52 2022] PUT /identity/v3/projects/7c1c618ffa404247bd5818c033826fc0/users/7b9f793b40a4482d9f01bfbd63b79ac9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:52.464072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f255-f3f0-4ebf-be51-4ca3e16d90e8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.464354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f255-f3f0-4ebf-be51-4ca3e16d90e8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.464623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488f255-f3f0-4ebf-be51-4ca3e16d90e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.498568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 819/1637] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:52.499421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b000b-3e42-472f-972b-70e467811705 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:52.507934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f488f255-f3f0-4ebf-be51-4ca3e16d90e8 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:52.513210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f488f255-f3f0-4ebf-be51-4ca3e16d90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:52.573579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b000b-3e42-472f-972b-70e467811705 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:52.670602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:52.704155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bd27c-a402-4ff0-8299-635df3e76144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:52.704783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bd27c-a402-4ff0-8299-635df3e76144 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.705059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bd27c-a402-4ff0-8299-635df3e76144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.705325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bd27c-a402-4ff0-8299-635df3e76144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.708180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 819/1638] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:52.710001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d789-9abd-41ad-9bd2-4ed61f117cd8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.710143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d789-9abd-41ad-9bd2-4ed61f117cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.710375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d789-9abd-41ad-9bd2-4ed61f117cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.732202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bd27c-a402-4ff0-8299-635df3e76144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:52.733652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bd27c-a402-4ff0-8299-635df3e76144 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:52.757827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 820/1639] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:52.772868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bd27c-a402-4ff0-8299-635df3e76144 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:52.798436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bd27c-a402-4ff0-8299-635df3e76144 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:52.800818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-da70d789-9abd-41ad-9bd2-4ed61f117cd8 None None] MFA Rules not processed for user `7b9f793b40a4482d9f01bfbd63b79ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:52.802287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-da70d789-9abd-41ad-9bd2-4ed61f117cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:52.816440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096761d-dbb5-40ae-9fab-a1c9942adb39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:52.816955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096761d-dbb5-40ae-9fab-a1c9942adb39 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:52.817303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096761d-dbb5-40ae-9fab-a1c9942adb39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:52.817506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096761d-dbb5-40ae-9fab-a1c9942adb39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:52.947107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096761d-dbb5-40ae-9fab-a1c9942adb39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:52.954287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096761d-dbb5-40ae-9fab-a1c9942adb39 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:53.013866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 821/1640] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:53.015106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096761d-dbb5-40ae-9fab-a1c9942adb39 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:53.054012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096761d-dbb5-40ae-9fab-a1c9942adb39 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:53.075342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8155-48e8-488a-95eb-0ea4dc079eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:53.084177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 820/1641] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:53.084353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8155-48e8-488a-95eb-0ea4dc079eba service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:53.084353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8155-48e8-488a-95eb-0ea4dc079eba service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:53.084353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8155-48e8-488a-95eb-0ea4dc079eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:53.099442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c8155-48e8-488a-95eb-0ea4dc079eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:53.100839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c8155-48e8-488a-95eb-0ea4dc079eba service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:53.114872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 822/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:53.813865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84738e4-4d0b-416f-a440-d56fd97404c9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:53.813865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84738e4-4d0b-416f-a440-d56fd97404c9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:53.814460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84738e4-4d0b-416f-a440-d56fd97404c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:53.862647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a84738e4-4d0b-416f-a440-d56fd97404c9 None None] MFA Rules not processed for user `234e374459f54ae89898c834f4d65071`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:53.865629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a84738e4-4d0b-416f-a440-d56fd97404c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:53.892921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:53.924382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8155-48e8-488a-95eb-0ea4dc079eba service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:53.937547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8155-48e8-488a-95eb-0ea4dc079eba service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:53.948150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e6530-50cb-4630-a118-4fc6a3def2b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:53.948872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e6530-50cb-4630-a118-4fc6a3def2b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:53.949360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e6530-50cb-4630-a118-4fc6a3def2b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:53.949730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e6530-50cb-4630-a118-4fc6a3def2b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:53.975846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e6530-50cb-4630-a118-4fc6a3def2b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:53.979293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e6530-50cb-4630-a118-4fc6a3def2b8 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:54.004395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 823/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:00:54.043850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e6530-50cb-4630-a118-4fc6a3def2b8 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:54.045780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 821/1644] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:54.240123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e6530-50cb-4630-a118-4fc6a3def2b8 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:54.312292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dbad7-7d7a-4984-889c-2e31fe294d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:54.312292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dbad7-7d7a-4984-889c-2e31fe294d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:54.312292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dbad7-7d7a-4984-889c-2e31fe294d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:54.312292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dbad7-7d7a-4984-889c-2e31fe294d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:54.319378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dbad7-7d7a-4984-889c-2e31fe294d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:54.323446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84738e4-4d0b-416f-a440-d56fd97404c9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:54.325889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dbad7-7d7a-4984-889c-2e31fe294d44 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:54.326323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84738e4-4d0b-416f-a440-d56fd97404c9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:54.326323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:54.326323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:54.326323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:54.326889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] PATH_INFO: `/v3/users/c980e06949dc4b8e9552600235c146b6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:54.329414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c980e06949dc4b8e9552600235c146b6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:54.331725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: WARNING py.warnings [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 05:00:54.331725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: warnings.warn(msg) Sep 24 05:00:54.331725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: Sep 24 05:00:54.338530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:54.357362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 824/1645] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:54 2022] POST /identity/v3/projects => generated 405 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:00:54.361252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dbad7-7d7a-4984-889c-2e31fe294d44 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:54.449630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:54.534656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dbad7-7d7a-4984-889c-2e31fe294d44 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:54.547586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:54.548209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:54.548480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:54.548747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:54.549546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:54.551536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:54.553982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c980e06949dc4b8e9552600235c146b6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:54.570345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c980e06949dc4b8e9552600235c146b6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:54.571009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c980e06949dc4b8e9552600235c146b6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:54.572734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c980e06949dc4b8e9552600235c146b6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:54.601558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 825/1646] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:54 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:54.605280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:54.615911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:54.617536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-61524f3e-937f-4501-b853-0aabebd3c122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c980e06949dc4b8e9552600235c146b6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:54.687017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85779-cd13-42e0-b8fa-0c719989a47a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:54.698977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4e341-fb1c-4676-8db0-1a24d5a2f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:54.702240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4e341-fb1c-4676-8db0-1a24d5a2f695 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:54.703057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4e341-fb1c-4676-8db0-1a24d5a2f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:54.703191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4e341-fb1c-4676-8db0-1a24d5a2f695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:54.704309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4e341-fb1c-4676-8db0-1a24d5a2f695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:54.709157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4e341-fb1c-4676-8db0-1a24d5a2f695 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:54.710402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 822/1647] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:00:54 2022] DELETE /identity/v3/users/c980e06949dc4b8e9552600235c146b6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:54.715607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ef9d3-e357-4f31-bf30-058623ce78af None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:54.715967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ef9d3-e357-4f31-bf30-058623ce78af None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:54.716243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ef9d3-e357-4f31-bf30-058623ce78af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:54.750455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 826/1648] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:00:54.751775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4e341-fb1c-4676-8db0-1a24d5a2f695 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:54.774203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4e341-fb1c-4676-8db0-1a24d5a2f695 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:54.784880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2a4ef9d3-e357-4f31-bf30-058623ce78af None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:54.786208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2a4ef9d3-e357-4f31-bf30-058623ce78af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:54.912907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e933f-fe6c-481a-8d15-454f493aeb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:54.913809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e933f-fe6c-481a-8d15-454f493aeb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:54.914575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e933f-fe6c-481a-8d15-454f493aeb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:54.915752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e933f-fe6c-481a-8d15-454f493aeb0f admin admin] PATH_INFO: `/v3/projects/a9ed512fe4924ac88e2f2e2a7d1138fb/users/084c096dbb804b6888d26c681ed81595/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:54.916718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 823/1649] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:54.934148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ef9d3-e357-4f31-bf30-058623ce78af None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:54.936334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2a4ef9d3-e357-4f31-bf30-058623ce78af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:54.957751 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e933f-fe6c-481a-8d15-454f493aeb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ed512fe4924ac88e2f2e2a7d1138fb, user_id=084c096dbb804b6888d26c681ed81595, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:54.965490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e933f-fe6c-481a-8d15-454f493aeb0f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:55.000902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 827/1650] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:54 2022] PUT /identity/v3/projects/a9ed512fe4924ac88e2f2e2a7d1138fb/users/084c096dbb804b6888d26c681ed81595/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:55.000902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e933f-fe6c-481a-8d15-454f493aeb0f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:55.012058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:55.092550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ef9d3-e357-4f31-bf30-058623ce78af None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:55.139184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e933f-fe6c-481a-8d15-454f493aeb0f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:55.158370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:55.164397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:55.169295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:55.169671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:55.171430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:55.189291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:55.201681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005809cd-2aff-450f-8cce-7e403f6cac24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:55.202663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005809cd-2aff-450f-8cce-7e403f6cac24 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:55.202663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005809cd-2aff-450f-8cce-7e403f6cac24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:55.203068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005809cd-2aff-450f-8cce-7e403f6cac24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:55.220178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005809cd-2aff-450f-8cce-7e403f6cac24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:55.224355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005809cd-2aff-450f-8cce-7e403f6cac24 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:55.232341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 828/1651] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:55.241346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 824/1652] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:55.241473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:55.241962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005809cd-2aff-450f-8cce-7e403f6cac24 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:55.249127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:55.254635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005809cd-2aff-450f-8cce-7e403f6cac24 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:55.261134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9d396-e673-4229-94ef-2ed9c34b72fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:55.262024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9d396-e673-4229-94ef-2ed9c34b72fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:55.262596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9d396-e673-4229-94ef-2ed9c34b72fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:55.263218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9d396-e673-4229-94ef-2ed9c34b72fa admin admin] PATH_INFO: `/v3/projects/a9ed512fe4924ac88e2f2e2a7d1138fb/users/084c096dbb804b6888d26c681ed81595/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:55.265370 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9d396-e673-4229-94ef-2ed9c34b72fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ed512fe4924ac88e2f2e2a7d1138fb, user_id=084c096dbb804b6888d26c681ed81595, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:55.269799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9d396-e673-4229-94ef-2ed9c34b72fa admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:55.279668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c2243-a51a-4f99-a501-8e06fe0aee52 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:55.318761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:55.320270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:55.320564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:55.320838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] PATH_INFO: `/v3/users/c105db01ffe5467e88aeaa17ab54dcac` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:55.327725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 825/1653] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:55 2022] PUT /identity/v3/projects/a9ed512fe4924ac88e2f2e2a7d1138fb/users/084c096dbb804b6888d26c681ed81595/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:55.329792 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c105db01ffe5467e88aeaa17ab54dcac)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:55.332134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:55.391927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:55.423429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c105db01ffe5467e88aeaa17ab54dcac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:55.437309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c105db01ffe5467e88aeaa17ab54dcac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:55.439479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c105db01ffe5467e88aeaa17ab54dcac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:55.440799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c105db01ffe5467e88aeaa17ab54dcac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:55.458629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c105db01ffe5467e88aeaa17ab54dcac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:55.492739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 829/1654] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:00:55 2022] DELETE /identity/v3/users/c105db01ffe5467e88aeaa17ab54dcac => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:55.499711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3518f-3ef9-4b3b-9140-00f2d49665eb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:55.500103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3518f-3ef9-4b3b-9140-00f2d49665eb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:55.500549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3518f-3ef9-4b3b-9140-00f2d49665eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:55.545094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-51c3518f-3ef9-4b3b-9140-00f2d49665eb None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:55.548110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-51c3518f-3ef9-4b3b-9140-00f2d49665eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:55.717450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 826/1655] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:00:55.741587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:55.744226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:55.887224 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eead52-723c-46ea-8e7e-786df4b2f301 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:55.899016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:55.902559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:55.902712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:55.903729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:55.933207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:55.935326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:55.960249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 830/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:56.925860 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3518f-3ef9-4b3b-9140-00f2d49665eb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:56.932094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-51c3518f-3ef9-4b3b-9140-00f2d49665eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:56.955600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3518f-3ef9-4b3b-9140-00f2d49665eb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:56.971444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:56.972032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:56.972312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:56.972584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] PATH_INFO: `/v3/users/cc5fd47f13c54854995e28ec01ad6e0e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:56.979838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5fd47f13c54854995e28ec01ad6e0e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:56.987040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:57.012086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:57.013659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:57.044635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90913e9-0da2-43f4-a0aa-ce24fdf1f90d service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:57.062905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:57.063629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:57.063827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:57.064100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] PATH_INFO: `/v3/projects/e20292bdd4ff41abac0d68af448b931e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:57.070992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20292bdd4ff41abac0d68af448b931e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:57.072539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 05:00:57.072539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: warnings.warn(msg) Sep 24 05:00:57.072539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: Sep 24 05:00:57.073763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:57.155834 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5fd47f13c54854995e28ec01ad6e0e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.179480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5fd47f13c54854995e28ec01ad6e0e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.181073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5fd47f13c54854995e28ec01ad6e0e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.182607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5fd47f13c54854995e28ec01ad6e0e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.228897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5fd47f13c54854995e28ec01ad6e0e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.245876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20292bdd4ff41abac0d68af448b931e', 'request_id': 'req-0c673d61-c1e2-4efd-83c5-b37467b61562'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.253758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:57.279653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20292bdd4ff41abac0d68af448b931e', 'request_id': 'req-0c673d61-c1e2-4efd-83c5-b37467b61562'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.280960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 827/1657] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:00:56 2022] DELETE /identity/v3/users/cc5fd47f13c54854995e28ec01ad6e0e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:57.284804 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:57.286033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:57.294659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20292bdd4ff41abac0d68af448b931e', 'request_id': 'req-0c673d61-c1e2-4efd-83c5-b37467b61562'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.332714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] The token cache is being invalidate because project e20292bdd4ff41abac0d68af448b931e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:00:57.334367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.336388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0c673d61-c1e2-4efd-83c5-b37467b61562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:57.340082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 831/1658] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:00:57 2022] DELETE /identity/v3/projects/e20292bdd4ff41abac0d68af448b931e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:00:57.344156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ba09-8936-43df-bec4-d0f74a93aab8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:57.344444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ba09-8936-43df-bec4-d0f74a93aab8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:57.344715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ba09-8936-43df-bec4-d0f74a93aab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:57.408760 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1679ba09-8936-43df-bec4-d0f74a93aab8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:57.409516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1679ba09-8936-43df-bec4-d0f74a93aab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:57.424972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a0d47-2e8b-4c27-b433-0504bd0036d0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:57.431613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5e7b5-bb2e-4b98-8e39-381db78e1866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:57.432275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e7b5-bb2e-4b98-8e39-381db78e1866 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:57.432549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e7b5-bb2e-4b98-8e39-381db78e1866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:57.432815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e7b5-bb2e-4b98-8e39-381db78e1866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:57.443198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2eb5e7b5-bb2e-4b98-8e39-381db78e1866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:57.482461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:57.565411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 832/1659] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:57.567559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf321d-cfd0-415a-90e9-2d34ffeefee4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:57.568120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf321d-cfd0-415a-90e9-2d34ffeefee4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:57.568120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf321d-cfd0-415a-90e9-2d34ffeefee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:57.619334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fdcf321d-cfd0-415a-90e9-2d34ffeefee4 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:57.620738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fdcf321d-cfd0-415a-90e9-2d34ffeefee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:57.628812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e7b5-bb2e-4b98-8e39-381db78e1866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:57.629548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e7b5-bb2e-4b98-8e39-381db78e1866 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:57.649015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 833/1660] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:57.653407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf321d-cfd0-415a-90e9-2d34ffeefee4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:57.655828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fdcf321d-cfd0-415a-90e9-2d34ffeefee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:57.662092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 828/1661] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:57.663365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400502-8a54-45c9-82fc-bff282300865 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:57.663651 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400502-8a54-45c9-82fc-bff282300865 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:57.663938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400502-8a54-45c9-82fc-bff282300865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:57.706285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3b400502-8a54-45c9-82fc-bff282300865 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:57.707598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3b400502-8a54-45c9-82fc-bff282300865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:57.742453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 829/1662] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:57.748059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400502-8a54-45c9-82fc-bff282300865 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:57.766517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400502-8a54-45c9-82fc-bff282300865 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:57.778923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:57.779859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:57.780555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:57.780895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:57.781654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:00:57.782058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:57.784032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:57.791904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf321d-cfd0-415a-90e9-2d34ffeefee4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:57.797849 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2dcd5-addb-4ebe-8286-98ba66a41c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:57.798960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2dcd5-addb-4ebe-8286-98ba66a41c92 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:57.799798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2dcd5-addb-4ebe-8286-98ba66a41c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:57.800088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2dcd5-addb-4ebe-8286-98ba66a41c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:57.813200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 830/1663] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:00:57.814385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:57.817431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2dcd5-addb-4ebe-8286-98ba66a41c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:57.820024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2dcd5-addb-4ebe-8286-98ba66a41c92 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:57.835860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 834/1664] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:00:57.842796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5fcf2-187f-4378-a251-7e7e5c8ca94b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:57.855155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddcace-dc25-46d3-bc94-8d13cbdab71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:57.855788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddcace-dc25-46d3-bc94-8d13cbdab71a admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:57.856068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddcace-dc25-46d3-bc94-8d13cbdab71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:57.856390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddcace-dc25-46d3-bc94-8d13cbdab71a admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:57.857034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddcace-dc25-46d3-bc94-8d13cbdab71a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:57.859209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddcace-dc25-46d3-bc94-8d13cbdab71a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:57.921711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 831/1665] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:57 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:57.927992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2dcd5-addb-4ebe-8286-98ba66a41c92 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:57.958587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2dcd5-addb-4ebe-8286-98ba66a41c92 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:58.176184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513ae9c-a9d0-42a8-9cf5-d01f15b77762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:58.177872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ae9c-a9d0-42a8-9cf5-d01f15b77762 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:58.178161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ae9c-a9d0-42a8-9cf5-d01f15b77762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:58.179116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ae9c-a9d0-42a8-9cf5-d01f15b77762 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:58.182675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513ae9c-a9d0-42a8-9cf5-d01f15b77762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:58.185641 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513ae9c-a9d0-42a8-9cf5-d01f15b77762 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:58.277714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 835/1666] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:57 2022] POST /identity/v3/users => generated 287 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:58.279722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddcace-dc25-46d3-bc94-8d13cbdab71a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:58.308692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddcace-dc25-46d3-bc94-8d13cbdab71a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:58.328641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0844-143e-49d8-974a-07205c6956a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:58.330208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0844-143e-49d8-974a-07205c6956a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:58.330504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0844-143e-49d8-974a-07205c6956a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:58.333461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0844-143e-49d8-974a-07205c6956a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:58.339611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0844-143e-49d8-974a-07205c6956a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:58.343668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0844-143e-49d8-974a-07205c6956a7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:58.392006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 832/1667] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:58.396522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513ae9c-a9d0-42a8-9cf5-d01f15b77762 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:58.413531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513ae9c-a9d0-42a8-9cf5-d01f15b77762 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:58.453185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802093d5-257b-4ea7-a699-82b6a6e75c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:58.456012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802093d5-257b-4ea7-a699-82b6a6e75c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:58.456544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802093d5-257b-4ea7-a699-82b6a6e75c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:58.457137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802093d5-257b-4ea7-a699-82b6a6e75c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:58.478378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802093d5-257b-4ea7-a699-82b6a6e75c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:58.485828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802093d5-257b-4ea7-a699-82b6a6e75c08 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:58.528113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 836/1668] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:58.528693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0844-143e-49d8-974a-07205c6956a7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:58.545108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0844-143e-49d8-974a-07205c6956a7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:58.559277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:58.561759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:58.561759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:58.567144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] PATH_INFO: `/v3/projects/e6972dae72484bff86dfab6fc29869a0/users/a39183f4544342b7bcf62bd12f3056a0/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:58.607929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6972dae72484bff86dfab6fc29869a0, user_id=a39183f4544342b7bcf62bd12f3056a0, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:58.611846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:58.653404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 833/1669] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:58 2022] PUT /identity/v3/projects/e6972dae72484bff86dfab6fc29869a0/users/a39183f4544342b7bcf62bd12f3056a0/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:58.666118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9a4b-29b1-4e63-99e3-8cd087e38ba2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:58.666959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9a4b-29b1-4e63-99e3-8cd087e38ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:58.667819 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9a4b-29b1-4e63-99e3-8cd087e38ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:58.746419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f5ee9a4b-29b1-4e63-99e3-8cd087e38ba2 None None] MFA Rules not processed for user `a39183f4544342b7bcf62bd12f3056a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:58.748298 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f5ee9a4b-29b1-4e63-99e3-8cd087e38ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:58.809689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:58.811633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:58.887569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:58.921548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:58.997218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 837/1670] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:59.002026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee9a4b-29b1-4e63-99e3-8cd087e38ba2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:59.072052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aa831-f10c-4bb6-9a2e-daab69fce4c9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:59.078703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:59.079941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:59.080531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:59.082258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] PATH_INFO: `/v3/projects/898d8a291ffa4d3284fa0124b594fd64` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:59.084703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=898d8a291ffa4d3284fa0124b594fd64)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:59.092249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:59.175803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee9a4b-29b1-4e63-99e3-8cd087e38ba2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:59.191310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaf4e2-0211-496d-a47b-9e4c652b4e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:59.192560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaf4e2-0211-496d-a47b-9e4c652b4e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:59.193147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaf4e2-0211-496d-a47b-9e4c652b4e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:59.193486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaf4e2-0211-496d-a47b-9e4c652b4e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:59.195292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaf4e2-0211-496d-a47b-9e4c652b4e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:59.199219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaf4e2-0211-496d-a47b-9e4c652b4e7a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:59.220977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898d8a291ffa4d3284fa0124b594fd64', 'request_id': 'req-2b7416ed-0d8c-4189-8b62-838b78883a1b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:59.235891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898d8a291ffa4d3284fa0124b594fd64', 'request_id': 'req-2b7416ed-0d8c-4189-8b62-838b78883a1b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:59.265483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898d8a291ffa4d3284fa0124b594fd64', 'request_id': 'req-2b7416ed-0d8c-4189-8b62-838b78883a1b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:59.297082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 838/1671] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:00:58 2022] POST /identity/v3/projects => generated 371 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:59.297082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca4de-1f21-40c3-9b04-c84897e4364a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:59.297082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca4de-1f21-40c3-9b04-c84897e4364a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:59.297082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca4de-1f21-40c3-9b04-c84897e4364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:59.304225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] The token cache is being invalidate because project 898d8a291ffa4d3284fa0124b594fd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:00:59.305156 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:59.308291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:00:59.312325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 834/1672] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:00:58 2022] DELETE /identity/v3/projects/898d8a291ffa4d3284fa0124b594fd64 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:00:59.316512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:59.326411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:59.355991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c82ca4de-1f21-40c3-9b04-c84897e4364a None None] MFA Rules not processed for user `084c096dbb804b6888d26c681ed81595`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:00:59.362844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c82ca4de-1f21-40c3-9b04-c84897e4364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:59.537140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7416ed-0d8c-4189-8b62-838b78883a1b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:59.549722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 839/1673] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:00:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:00:59.550469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ca4de-1f21-40c3-9b04-c84897e4364a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:59.574349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c82ca4de-1f21-40c3-9b04-c84897e4364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:00:59.702032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec94ef-f2de-4690-9b29-dc1a37183b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:59.702665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec94ef-f2de-4690-9b29-dc1a37183b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:59.702969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec94ef-f2de-4690-9b29-dc1a37183b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:59.703239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec94ef-f2de-4690-9b29-dc1a37183b80 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:59.703881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec94ef-f2de-4690-9b29-dc1a37183b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:59.705828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec94ef-f2de-4690-9b29-dc1a37183b80 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:59.728968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:59.755760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 835/1674] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:00:59 2022] POST /identity/v3/users => generated 292 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:00:59.761789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec94ef-f2de-4690-9b29-dc1a37183b80 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:59.771384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:59.794801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec94ef-f2de-4690-9b29-dc1a37183b80 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:59.821028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ca4de-1f21-40c3-9b04-c84897e4364a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:59.826221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ea697-0138-436c-b07a-b4550d6447e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:59.826944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ea697-0138-436c-b07a-b4550d6447e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:59.827154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ea697-0138-436c-b07a-b4550d6447e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:59.828352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ea697-0138-436c-b07a-b4550d6447e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:59.829031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ea697-0138-436c-b07a-b4550d6447e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:59.831358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ea697-0138-436c-b07a-b4550d6447e0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:59.832338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:59.835384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:59.836346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:59.837731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] PATH_INFO: `/v3/users/7b9f793b40a4482d9f01bfbd63b79ac9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:59.842023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9f793b40a4482d9f01bfbd63b79ac9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:59.846785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:59.869652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 836/1675] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:00:59.870694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ea697-0138-436c-b07a-b4550d6447e0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:00:59.897149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ea697-0138-436c-b07a-b4550d6447e0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:00:59.906157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:00:59.906874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:00:59.907153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:00:59.907458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] PATH_INFO: `/v3/projects/3cf5c47836764cee995a6a13e2b355a2/users/b231c36890824fddbd26d93e63b3f245/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:00:59.952845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf5c47836764cee995a6a13e2b355a2, user_id=b231c36890824fddbd26d93e63b3f245, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:00:59.955619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:00:59.988818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 837/1676] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:00:59 2022] PUT /identity/v3/projects/3cf5c47836764cee995a6a13e2b355a2/users/b231c36890824fddbd26d93e63b3f245/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:00:59.989729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:00.000400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:00.001747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9f793b40a4482d9f01bfbd63b79ac9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.040685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9f793b40a4482d9f01bfbd63b79ac9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.042049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9f793b40a4482d9f01bfbd63b79ac9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.042895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9f793b40a4482d9f01bfbd63b79ac9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.056613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9f793b40a4482d9f01bfbd63b79ac9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.097785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 840/1677] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:00:59 2022] DELETE /identity/v3/users/7b9f793b40a4482d9f01bfbd63b79ac9 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:00.098745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:00.106474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:00.149633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446ec3b-2408-4ad2-b81e-3b63cef09936 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:00.279782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa437d17-a575-409a-a3eb-2bfb830fcc90 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:00.297855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0899e-352b-4c5e-86bf-db8adcd9fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:00.298686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0899e-352b-4c5e-86bf-db8adcd9fddc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:00.299117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0899e-352b-4c5e-86bf-db8adcd9fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:00.299495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0899e-352b-4c5e-86bf-db8adcd9fddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:00.300451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0899e-352b-4c5e-86bf-db8adcd9fddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:00.302151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0899e-352b-4c5e-86bf-db8adcd9fddc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:00.302995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:00.303800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:00.304236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:00.304652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] PATH_INFO: `/v3/projects/61f314a18b2345da9891f07575f1e343` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:00.311904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f314a18b2345da9891f07575f1e343)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:00.314480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:00.327171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 841/1678] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:00.331594 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0899e-352b-4c5e-86bf-db8adcd9fddc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:00.358046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0899e-352b-4c5e-86bf-db8adcd9fddc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:00.373600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09337375-4c80-4c23-af90-f4deafd74d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:00.378602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09337375-4c80-4c23-af90-f4deafd74d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:00.380268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09337375-4c80-4c23-af90-f4deafd74d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:00.382066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09337375-4c80-4c23-af90-f4deafd74d8c admin admin] PATH_INFO: `/v3/projects/3cf5c47836764cee995a6a13e2b355a2/users/b231c36890824fddbd26d93e63b3f245/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:00.388141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09337375-4c80-4c23-af90-f4deafd74d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf5c47836764cee995a6a13e2b355a2, user_id=b231c36890824fddbd26d93e63b3f245, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:00.395973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09337375-4c80-4c23-af90-f4deafd74d8c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:00.437300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 842/1679] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:00 2022] PUT /identity/v3/projects/3cf5c47836764cee995a6a13e2b355a2/users/b231c36890824fddbd26d93e63b3f245/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:00.437488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f314a18b2345da9891f07575f1e343', 'request_id': 'req-e9b84137-468e-4e4f-bc18-6a05ecaaf059'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.439403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230ba3-c40a-461a-8f3f-dbbc216d7f98 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:00.439788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230ba3-c40a-461a-8f3f-dbbc216d7f98 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:00.440160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230ba3-c40a-461a-8f3f-dbbc216d7f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:00.453033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f314a18b2345da9891f07575f1e343', 'request_id': 'req-e9b84137-468e-4e4f-bc18-6a05ecaaf059'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.462831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:00.475316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f314a18b2345da9891f07575f1e343', 'request_id': 'req-e9b84137-468e-4e4f-bc18-6a05ecaaf059'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.504362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] The token cache is being invalidate because project 61f314a18b2345da9891f07575f1e343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:00.504754 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.505522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e9b84137-468e-4e4f-bc18-6a05ecaaf059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:00.511880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 838/1680] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:00:59 2022] DELETE /identity/v3/projects/61f314a18b2345da9891f07575f1e343 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:00.512971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2d230ba3-c40a-461a-8f3f-dbbc216d7f98 None None] MFA Rules not processed for user `b231c36890824fddbd26d93e63b3f245`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:00.514834 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f547c6-25e4-456c-9dbd-c4850fe79bb9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:00.515124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f547c6-25e4-456c-9dbd-c4850fe79bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:00.515465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f547c6-25e4-456c-9dbd-c4850fe79bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:00.518988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d230ba3-c40a-461a-8f3f-dbbc216d7f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:00.569102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b3f547c6-25e4-456c-9dbd-c4850fe79bb9 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:00.572948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b3f547c6-25e4-456c-9dbd-c4850fe79bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:00.623889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:00.739225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 843/1681] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:00.749956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230ba3-c40a-461a-8f3f-dbbc216d7f98 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:00.752720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d230ba3-c40a-461a-8f3f-dbbc216d7f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:00.762020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 839/1682] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:00.769089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f54663-867f-4006-977a-caa95aa69524 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:00.769829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f54663-867f-4006-977a-caa95aa69524 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:00.771556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f54663-867f-4006-977a-caa95aa69524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:00.818216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-00f54663-867f-4006-977a-caa95aa69524 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:00.823305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-00f54663-867f-4006-977a-caa95aa69524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:00.854848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 840/1683] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:00.856526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f54663-867f-4006-977a-caa95aa69524 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:00.873101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f54663-867f-4006-977a-caa95aa69524 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:00.890614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:00.891291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:00.891569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:00.891847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:00.892516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:00.892822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:00.894451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:00.933233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 841/1684] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:01:00.937744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:00.953778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7425cd-4771-46b6-89c7-d609d122ea18 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:00.971615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b4cbe-550f-4cea-bd20-7afd73f4b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:00.972246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b4cbe-550f-4cea-bd20-7afd73f4b673 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:00.972544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b4cbe-550f-4cea-bd20-7afd73f4b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:00.975149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b4cbe-550f-4cea-bd20-7afd73f4b673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:00.978865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b4cbe-550f-4cea-bd20-7afd73f4b673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:00.983547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b4cbe-550f-4cea-bd20-7afd73f4b673 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:00.992094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230ba3-c40a-461a-8f3f-dbbc216d7f98 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:01.020495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77844306-5779-4250-8c23-498bddd9e79d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:01.021966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77844306-5779-4250-8c23-498bddd9e79d service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:01.026136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77844306-5779-4250-8c23-498bddd9e79d service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:01.026877 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77844306-5779-4250-8c23-498bddd9e79d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:01.059365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 842/1685] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:00 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:01.065478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77844306-5779-4250-8c23-498bddd9e79d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:01.067850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b4cbe-550f-4cea-bd20-7afd73f4b673 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:01.070833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77844306-5779-4250-8c23-498bddd9e79d service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:01.136486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 844/1686] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:01.183722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b4cbe-550f-4cea-bd20-7afd73f4b673 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:01.201324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:01.202104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:01.202254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:01.203265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:01.203265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:01.205092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:01.259391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 843/1687] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:01 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:01.262045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77844306-5779-4250-8c23-498bddd9e79d service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:01.281662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77844306-5779-4250-8c23-498bddd9e79d service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:01.323713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f1d85-9b33-427d-9389-fc66ed23fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:01.324524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f1d85-9b33-427d-9389-fc66ed23fcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:01.324802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f1d85-9b33-427d-9389-fc66ed23fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:01.325152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f1d85-9b33-427d-9389-fc66ed23fcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:01.325722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f1d85-9b33-427d-9389-fc66ed23fcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:01.327382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f1d85-9b33-427d-9389-fc66ed23fcd1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:01.374940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:01.375859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 845/1688] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:01.377233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:01.380824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f1d85-9b33-427d-9389-fc66ed23fcd1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:01.407460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f1d85-9b33-427d-9389-fc66ed23fcd1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:01.414813 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564152e7-3fe6-47b0-99e6-757d43bbb394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:01.415807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564152e7-3fe6-47b0-99e6-757d43bbb394 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:01.416119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564152e7-3fe6-47b0-99e6-757d43bbb394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:01.416588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564152e7-3fe6-47b0-99e6-757d43bbb394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:01.417245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564152e7-3fe6-47b0-99e6-757d43bbb394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:01.421596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564152e7-3fe6-47b0-99e6-757d43bbb394 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:01.439836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 846/1689] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:01.444074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564152e7-3fe6-47b0-99e6-757d43bbb394 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:01.458080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:01.476769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564152e7-3fe6-47b0-99e6-757d43bbb394 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:01.483694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2997a-c6fc-44f5-b595-ba99adc06b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:01.487923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2997a-c6fc-44f5-b595-ba99adc06b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:01.489337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2997a-c6fc-44f5-b595-ba99adc06b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:01.490794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2997a-c6fc-44f5-b595-ba99adc06b7f admin admin] PATH_INFO: `/v3/projects/95d0415f4ad04890ad028d8976f19cfd/users/0642a640ea774c77a9f47a19ab122168/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:01.505504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90163346-bd31-4da1-8884-abdb35d2a6e6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:01.511985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b5023-f97a-4485-98c1-145800a52053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:01.515439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b5023-f97a-4485-98c1-145800a52053 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:01.515439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b5023-f97a-4485-98c1-145800a52053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:01.515439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b5023-f97a-4485-98c1-145800a52053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:01.517684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-249b5023-f97a-4485-98c1-145800a52053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:01.547804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2997a-c6fc-44f5-b595-ba99adc06b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d0415f4ad04890ad028d8976f19cfd, user_id=0642a640ea774c77a9f47a19ab122168, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:01.554005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2997a-c6fc-44f5-b595-ba99adc06b7f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:01.597445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 847/1690] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:01 2022] PUT /identity/v3/projects/95d0415f4ad04890ad028d8976f19cfd/users/0642a640ea774c77a9f47a19ab122168/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:01.610829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baf03f-c7d8-471d-8139-5969538f4466 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:01.611380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baf03f-c7d8-471d-8139-5969538f4466 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:01.611818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baf03f-c7d8-471d-8139-5969538f4466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:01.642356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b5023-f97a-4485-98c1-145800a52053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:01.647575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b5023-f97a-4485-98c1-145800a52053 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:01.663677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 844/1691] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:01.687064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a6baf03f-c7d8-471d-8139-5969538f4466 None None] MFA Rules not processed for user `0642a640ea774c77a9f47a19ab122168`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:01.688527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a6baf03f-c7d8-471d-8139-5969538f4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:01.768473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587921b5-0a7d-4d03-ad2b-8dff2b46f9a4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:01.768952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587921b5-0a7d-4d03-ad2b-8dff2b46f9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:01.769724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587921b5-0a7d-4d03-ad2b-8dff2b46f9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:01.861319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 848/1692] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:01.862280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baf03f-c7d8-471d-8139-5969538f4466 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:01.873155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a6baf03f-c7d8-471d-8139-5969538f4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:01.874821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-587921b5-0a7d-4d03-ad2b-8dff2b46f9a4 None None] MFA Rules not processed for user `cd5ac67dae69446eb8695af69daa439f`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:01.876416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-587921b5-0a7d-4d03-ad2b-8dff2b46f9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:01.923844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:02.070496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baf03f-c7d8-471d-8139-5969538f4466 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.078310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.079484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.080129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.080586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] PATH_INFO: `/v3/projects/7c1c618ffa404247bd5818c033826fc0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.083004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1c618ffa404247bd5818c033826fc0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.085373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:02.147546 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 845/1693] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:02.148476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587921b5-0a7d-4d03-ad2b-8dff2b46f9a4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.190099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587921b5-0a7d-4d03-ad2b-8dff2b46f9a4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.193215 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1c618ffa404247bd5818c033826fc0', 'request_id': 'req-9d1f190f-1724-4ea4-bae9-cd4774506d6a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:02.210891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1c618ffa404247bd5818c033826fc0', 'request_id': 'req-9d1f190f-1724-4ea4-bae9-cd4774506d6a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:02.230440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1c618ffa404247bd5818c033826fc0', 'request_id': 'req-9d1f190f-1724-4ea4-bae9-cd4774506d6a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:02.262935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] The token cache is being invalidate because project 7c1c618ffa404247bd5818c033826fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:02.263259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:02.264836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d1f190f-1724-4ea4-bae9-cd4774506d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:02.268525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 849/1694] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:01 2022] DELETE /identity/v3/projects/7c1c618ffa404247bd5818c033826fc0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:02.269888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92268322-58a9-4820-a7a3-c26322359449 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.270266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92268322-58a9-4820-a7a3-c26322359449 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.271176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92268322-58a9-4820-a7a3-c26322359449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.305374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3ed4c-165a-4386-838c-77b5f1677da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.307191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ed4c-165a-4386-838c-77b5f1677da5 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.307689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ed4c-165a-4386-838c-77b5f1677da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.308349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ed4c-165a-4386-838c-77b5f1677da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.309131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ed4c-165a-4386-838c-77b5f1677da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.311841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ed4c-165a-4386-838c-77b5f1677da5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:02.324103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-92268322-58a9-4820-a7a3-c26322359449 None None] MFA Rules not processed for user `cd5ac67dae69446eb8695af69daa439f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:02.326733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-92268322-58a9-4820-a7a3-c26322359449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:02.358120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 846/1695] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:02 2022] POST /identity/v3/projects => generated 403 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:02.358332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65d8a-7cda-4a0e-af45-ecbc687bcac8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.358476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65d8a-7cda-4a0e-af45-ecbc687bcac8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.358829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65d8a-7cda-4a0e-af45-ecbc687bcac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.386161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-84e65d8a-7cda-4a0e-af45-ecbc687bcac8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:02.387532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-84e65d8a-7cda-4a0e-af45-ecbc687bcac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:02.393633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:02.492661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 850/1696] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:02.494693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92268322-58a9-4820-a7a3-c26322359449 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.507830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-92268322-58a9-4820-a7a3-c26322359449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:02.530921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 847/1697] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:02.531109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92268322-58a9-4820-a7a3-c26322359449 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.531186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65d8a-7cda-4a0e-af45-ecbc687bcac8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.531186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-84e65d8a-7cda-4a0e-af45-ecbc687bcac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:02.538421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b6bba-a407-49b0-b31e-039b00171b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.539340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6bba-a407-49b0-b31e-039b00171b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.539715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6bba-a407-49b0-b31e-039b00171b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.540606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6bba-a407-49b0-b31e-039b00171b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.541330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b6bba-a407-49b0-b31e-039b00171b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.543673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b6bba-a407-49b0-b31e-039b00171b24 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:02.572542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 851/1698] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:02 2022] POST /identity/v3/users => generated 308 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:02.573973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da3a7-fe85-44f4-9524-59c4be527f66 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.574351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da3a7-fe85-44f4-9524-59c4be527f66 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.574703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da3a7-fe85-44f4-9524-59c4be527f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.599472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1a4da3a7-fe85-44f4-9524-59c4be527f66 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:02.600558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1a4da3a7-fe85-44f4-9524-59c4be527f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:02.616855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 852/1699] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:02.624039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4da3a7-fe85-44f4-9524-59c4be527f66 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.645761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4da3a7-fe85-44f4-9524-59c4be527f66 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.657971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8276-21e1-4f80-a297-adb66cb278da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.657971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8276-21e1-4f80-a297-adb66cb278da admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.658346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8276-21e1-4f80-a297-adb66cb278da admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.658346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8276-21e1-4f80-a297-adb66cb278da admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.659935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a8276-21e1-4f80-a297-adb66cb278da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.662784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a8276-21e1-4f80-a297-adb66cb278da admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:02.680231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 853/1700] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:02.682076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8276-21e1-4f80-a297-adb66cb278da admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.693685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8276-21e1-4f80-a297-adb66cb278da admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.699235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.699722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.700004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65d8a-7cda-4a0e-af45-ecbc687bcac8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.700106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.700446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.701209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:02.701590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.703386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:02.718629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 854/1701] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:02.722862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.729360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.730143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.730422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.730544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:02.730682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.735162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc99ef-1f6f-4457-945f-6e583616a480 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.736863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:02.748884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c09f5f-ec27-4496-9fb4-611b1d0c2c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.750669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c09f5f-ec27-4496-9fb4-611b1d0c2c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.751251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c09f5f-ec27-4496-9fb4-611b1d0c2c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.753551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c09f5f-ec27-4496-9fb4-611b1d0c2c30 admin admin] PATH_INFO: `/v3/projects/ec8da0aeecc94a79a79d4e02e971d429/users/c80ab49dea5a45d4b625500f7b1d13a3/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.788239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c09f5f-ec27-4496-9fb4-611b1d0c2c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8da0aeecc94a79a79d4e02e971d429, user_id=c80ab49dea5a45d4b625500f7b1d13a3, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.791033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c09f5f-ec27-4496-9fb4-611b1d0c2c30 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:02.812675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 855/1702] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:02 2022] PUT /identity/v3/projects/ec8da0aeecc94a79a79d4e02e971d429/users/c80ab49dea5a45d4b625500f7b1d13a3/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:02.813687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c09f5f-ec27-4496-9fb4-611b1d0c2c30 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.876275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.878236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:02.901650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 848/1703] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:02.902404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.933123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e325b-73ee-457e-83a4-cee1082c0929 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.942967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333339ee-2ae8-45d9-9916-9e17b05d64be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.943621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333339ee-2ae8-45d9-9916-9e17b05d64be admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.945567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333339ee-2ae8-45d9-9916-9e17b05d64be admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.946991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333339ee-2ae8-45d9-9916-9e17b05d64be admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.947678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333339ee-2ae8-45d9-9916-9e17b05d64be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.951590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333339ee-2ae8-45d9-9916-9e17b05d64be admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:02.954161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c09f5f-ec27-4496-9fb4-611b1d0c2c30 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:02.966047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2e47-8e29-49e6-8378-580b99f44bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:02.966450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2e47-8e29-49e6-8378-580b99f44bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:02.966719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2e47-8e29-49e6-8378-580b99f44bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:02.967044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2e47-8e29-49e6-8378-580b99f44bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:02.969875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d2e47-8e29-49e6-8378-580b99f44bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:02.975107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 849/1704] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:02.979131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333339ee-2ae8-45d9-9916-9e17b05d64be admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:02.979299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d2e47-8e29-49e6-8378-580b99f44bb4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:03.003268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333339ee-2ae8-45d9-9916-9e17b05d64be admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:03.012605 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45731786-5d98-4f4e-bfb2-84a797a181d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:03.013535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45731786-5d98-4f4e-bfb2-84a797a181d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.014182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45731786-5d98-4f4e-bfb2-84a797a181d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.014488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45731786-5d98-4f4e-bfb2-84a797a181d3 admin admin] PATH_INFO: `/v3/projects/ec8da0aeecc94a79a79d4e02e971d429/users/c80ab49dea5a45d4b625500f7b1d13a3/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.018467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45731786-5d98-4f4e-bfb2-84a797a181d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8da0aeecc94a79a79d4e02e971d429, user_id=c80ab49dea5a45d4b625500f7b1d13a3, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:03.025420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45731786-5d98-4f4e-bfb2-84a797a181d3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:03.050108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 856/1705] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:02 2022] POST /identity/v3/projects => generated 357 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:03.051904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2e47-8e29-49e6-8378-580b99f44bb4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:03.052185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 850/1706] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:02 2022] PUT /identity/v3/projects/ec8da0aeecc94a79a79d4e02e971d429/users/c80ab49dea5a45d4b625500f7b1d13a3/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:03.063456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d466b0-9e7f-4fb3-ada0-795990069cee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.063830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d466b0-9e7f-4fb3-ada0-795990069cee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.064059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d466b0-9e7f-4fb3-ada0-795990069cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.152838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a1d466b0-9e7f-4fb3-ada0-795990069cee None None] MFA Rules not processed for user `c80ab49dea5a45d4b625500f7b1d13a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:03.154096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a1d466b0-9e7f-4fb3-ada0-795990069cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:03.189914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:03.190786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2e47-8e29-49e6-8378-580b99f44bb4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:03.200053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3cf30-5e7e-4994-af21-358087644b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:03.200712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3cf30-5e7e-4994-af21-358087644b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.201000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3cf30-5e7e-4994-af21-358087644b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.201306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3cf30-5e7e-4994-af21-358087644b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.210968 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3cf30-5e7e-4994-af21-358087644b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:03.210968 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3cf30-5e7e-4994-af21-358087644b7e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:03.252390 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 857/1707] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:03 2022] POST /identity/v3/users => generated 279 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:03.253554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3cf30-5e7e-4994-af21-358087644b7e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:03.317250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3cf30-5e7e-4994-af21-358087644b7e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:03.342322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c8381-1757-4e76-b132-f9a7cb063356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:03.344179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8381-1757-4e76-b132-f9a7cb063356 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.344801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8381-1757-4e76-b132-f9a7cb063356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.345264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8381-1757-4e76-b132-f9a7cb063356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.346234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c8381-1757-4e76-b132-f9a7cb063356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:03.350640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c8381-1757-4e76-b132-f9a7cb063356 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:03.391280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 858/1708] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:03.395731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c8381-1757-4e76-b132-f9a7cb063356 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:03.414312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c8381-1757-4e76-b132-f9a7cb063356 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:03.431179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5fd54-d39a-4e34-9033-731bb84a8894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:03.432449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5fd54-d39a-4e34-9033-731bb84a8894 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.432937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5fd54-d39a-4e34-9033-731bb84a8894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.433634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5fd54-d39a-4e34-9033-731bb84a8894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.435160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5fd54-d39a-4e34-9033-731bb84a8894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:03.437970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5fd54-d39a-4e34-9033-731bb84a8894 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:03.440252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 851/1709] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:03.470277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 859/1710] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:01:03.474024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d466b0-9e7f-4fb3-ada0-795990069cee None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:03.475523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a1d466b0-9e7f-4fb3-ada0-795990069cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:03.480080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5fd54-d39a-4e34-9033-731bb84a8894 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:03.518947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5fd54-d39a-4e34-9033-731bb84a8894 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:03.534697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec74b-44b5-463e-bbeb-0a8ce07675cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:03.536494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec74b-44b5-463e-bbeb-0a8ce07675cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.537230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec74b-44b5-463e-bbeb-0a8ce07675cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.537654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec74b-44b5-463e-bbeb-0a8ce07675cb admin admin] PATH_INFO: `/v3/projects/b95598c9fcce44ad95580a00c7b31fe3/users/61cccaa9f7c041249a80bb27efe950d5/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.586216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec74b-44b5-463e-bbeb-0a8ce07675cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95598c9fcce44ad95580a00c7b31fe3, user_id=61cccaa9f7c041249a80bb27efe950d5, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:03.593538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec74b-44b5-463e-bbeb-0a8ce07675cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:03.628836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 860/1711] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:03 2022] PUT /identity/v3/projects/b95598c9fcce44ad95580a00c7b31fe3/users/61cccaa9f7c041249a80bb27efe950d5/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:03.635425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91456-cccb-4ee1-b09d-7404e84b4091 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.635864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91456-cccb-4ee1-b09d-7404e84b4091 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.636607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a91456-cccb-4ee1-b09d-7404e84b4091 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.642422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 861/1712] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:01:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:01:03.646804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3145f-7302-4bc7-a539-25a1b9dfc424 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.647218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3145f-7302-4bc7-a539-25a1b9dfc424 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.647632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3145f-7302-4bc7-a539-25a1b9dfc424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.647815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d466b0-9e7f-4fb3-ada0-795990069cee None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:03.701634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:03.726502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5dd3145f-7302-4bc7-a539-25a1b9dfc424 None None] MFA Rules not processed for user `61cccaa9f7c041249a80bb27efe950d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:03.728965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5dd3145f-7302-4bc7-a539-25a1b9dfc424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:03.761800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9647df9-bd22-42d1-aab1-6e3d5389d938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:03.764036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647df9-bd22-42d1-aab1-6e3d5389d938 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.765278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647df9-bd22-42d1-aab1-6e3d5389d938 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.766535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647df9-bd22-42d1-aab1-6e3d5389d938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.922493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 862/1713] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:03.925165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a7bcf-1aee-43d0-927a-1586ca06d3fd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:03.926024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a7bcf-1aee-43d0-927a-1586ca06d3fd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:03.926230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a7bcf-1aee-43d0-927a-1586ca06d3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:03.940885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9647df9-bd22-42d1-aab1-6e3d5389d938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:03.950857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9647df9-bd22-42d1-aab1-6e3d5389d938 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:04.008282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 852/1714] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:03 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:04.012799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9647df9-bd22-42d1-aab1-6e3d5389d938 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:04.030875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c38a7bcf-1aee-43d0-927a-1586ca06d3fd None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:04.041344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c38a7bcf-1aee-43d0-927a-1586ca06d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:04.089203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:04.239086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 863/1715] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:01:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:04.275404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a7bcf-1aee-43d0-927a-1586ca06d3fd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:04.277548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c38a7bcf-1aee-43d0-927a-1586ca06d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:04.315492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a7bcf-1aee-43d0-927a-1586ca06d3fd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:04.328697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9647df9-bd22-42d1-aab1-6e3d5389d938 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:04.331772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fc3c7-2d21-48a5-a3a1-fba9006a3771 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:04.333877 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc3c7-2d21-48a5-a3a1-fba9006a3771 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:04.334165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc3c7-2d21-48a5-a3a1-fba9006a3771 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:04.334441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc3c7-2d21-48a5-a3a1-fba9006a3771 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:04.359672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec0962-b98c-4cfd-80a0-66781722503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:04.363701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0962-b98c-4cfd-80a0-66781722503f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:04.363988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0962-b98c-4cfd-80a0-66781722503f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:04.364264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec0962-b98c-4cfd-80a0-66781722503f admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:04.370186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fc3c7-2d21-48a5-a3a1-fba9006a3771 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:04.371438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0962-b98c-4cfd-80a0-66781722503f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:04.374786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fc3c7-2d21-48a5-a3a1-fba9006a3771 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:04.379185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec0962-b98c-4cfd-80a0-66781722503f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:04.439049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 864/1716] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:04.472350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fc3c7-2d21-48a5-a3a1-fba9006a3771 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:04.488869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fc3c7-2d21-48a5-a3a1-fba9006a3771 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:04.501881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:04.503008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:04.503293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:04.503854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] PATH_INFO: `/v3/users/0642a640ea774c77a9f47a19ab122168` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:04.505819 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0642a640ea774c77a9f47a19ab122168)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:04.509712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:04.515014 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 853/1717] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:04 2022] POST /identity/v3/projects => generated 357 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:04.517439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44863a8c-09d2-4d86-9d75-b7159899c35f None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:04.517803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44863a8c-09d2-4d86-9d75-b7159899c35f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:04.518078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44863a8c-09d2-4d86-9d75-b7159899c35f None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:04.521109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 854/1718] 10.222.0.26 () {54 vars in 912 bytes} [Sat Sep 24 05:01:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:01:04.542383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44863a8c-09d2-4d86-9d75-b7159899c35f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:04.633914 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0642a640ea774c77a9f47a19ab122168'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:04.659929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0642a640ea774c77a9f47a19ab122168'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:04.660866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0642a640ea774c77a9f47a19ab122168'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:04.661508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0642a640ea774c77a9f47a19ab122168'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:04.674604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc2a0e11-44b6-47ee-a808-bc39da13cb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0642a640ea774c77a9f47a19ab122168'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:04.699048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:04.718343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 865/1719] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:04 2022] DELETE /identity/v3/users/0642a640ea774c77a9f47a19ab122168 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:04.728259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995082f-6824-4e22-9775-b585854d8392 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:04.728837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995082f-6824-4e22-9775-b585854d8392 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:04.729586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995082f-6824-4e22-9775-b585854d8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:04.729842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44863a8c-09d2-4d86-9d75-b7159899c35f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:04.804555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6995082f-6824-4e22-9775-b585854d8392 None None] MFA Rules not processed for user `f50dc809ff034866a1f6343e5b32609b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:04.806991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6995082f-6824-4e22-9775-b585854d8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:04.845183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70221873-22e8-4002-bf6d-a2b5db93f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:04.846196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70221873-22e8-4002-bf6d-a2b5db93f5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:04.846548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70221873-22e8-4002-bf6d-a2b5db93f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:04.846907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70221873-22e8-4002-bf6d-a2b5db93f5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:04.848487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70221873-22e8-4002-bf6d-a2b5db93f5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:04.851520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70221873-22e8-4002-bf6d-a2b5db93f5f8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:04.887365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 855/1720] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:04 2022] POST /identity/v3/users => generated 285 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:04.891070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4723fe8-47a6-4689-a9ca-d4b4b64cd152 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:04.891364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4723fe8-47a6-4689-a9ca-d4b4b64cd152 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:04.891636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4723fe8-47a6-4689-a9ca-d4b4b64cd152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:04.932077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c4723fe8-47a6-4689-a9ca-d4b4b64cd152 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:04.933325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c4723fe8-47a6-4689-a9ca-d4b4b64cd152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:04.941759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 866/1721] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:01:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:04.942909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995082f-6824-4e22-9775-b585854d8392 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:04.944707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6995082f-6824-4e22-9775-b585854d8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:04.951822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 856/1722] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:04.961007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4723fe8-47a6-4689-a9ca-d4b4b64cd152 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:04.963220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c4723fe8-47a6-4689-a9ca-d4b4b64cd152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:04.982189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995082f-6824-4e22-9775-b585854d8392 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:04.995192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4723fe8-47a6-4689-a9ca-d4b4b64cd152 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:04.998122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db65de0-5790-419b-9f23-db2eff4dac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:04.998974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db65de0-5790-419b-9f23-db2eff4dac69 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:04.999351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db65de0-5790-419b-9f23-db2eff4dac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:04.999721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db65de0-5790-419b-9f23-db2eff4dac69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:05.000210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9f6e9-a942-4d8e-9c1a-3c89027bb1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:05.000568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db65de0-5790-419b-9f23-db2eff4dac69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:05.001391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9f6e9-a942-4d8e-9c1a-3c89027bb1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:05.002362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db65de0-5790-419b-9f23-db2eff4dac69 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:05.002848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9f6e9-a942-4d8e-9c1a-3c89027bb1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:05.004342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9f6e9-a942-4d8e-9c1a-3c89027bb1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:05.022262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9f6e9-a942-4d8e-9c1a-3c89027bb1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:05.024228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9f6e9-a942-4d8e-9c1a-3c89027bb1c2 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:05.031119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 867/1723] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:05.032078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db65de0-5790-419b-9f23-db2eff4dac69 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:05.048197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 857/1724] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:05.049279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9f6e9-a942-4d8e-9c1a-3c89027bb1c2 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:05.057073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db65de0-5790-419b-9f23-db2eff4dac69 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:05.069216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced74c-d42f-44e5-bddc-1884ac078e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:05.069848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced74c-d42f-44e5-bddc-1884ac078e8a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:05.070116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced74c-d42f-44e5-bddc-1884ac078e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:05.070385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced74c-d42f-44e5-bddc-1884ac078e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:05.081665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9f6e9-a942-4d8e-9c1a-3c89027bb1c2 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:05.089857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ced74c-d42f-44e5-bddc-1884ac078e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:05.094495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ced74c-d42f-44e5-bddc-1884ac078e8a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:05.104470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ff14-ddcb-4a32-8e52-50dd107340de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:05.105498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ff14-ddcb-4a32-8e52-50dd107340de admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:05.105498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ff14-ddcb-4a32-8e52-50dd107340de admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:05.105688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ff14-ddcb-4a32-8e52-50dd107340de admin admin] PATH_INFO: `/v3/projects/c33bd252794e4f0e92f458cc2039ec3e/users/20694b4dc81d43b394dde2a74ff572a9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:05.120090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 868/1725] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:05.141023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:05.149620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04ff14-ddcb-4a32-8e52-50dd107340de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33bd252794e4f0e92f458cc2039ec3e, user_id=20694b4dc81d43b394dde2a74ff572a9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:05.152641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04ff14-ddcb-4a32-8e52-50dd107340de admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:05.188635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 858/1726] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:05 2022] PUT /identity/v3/projects/c33bd252794e4f0e92f458cc2039ec3e/users/20694b4dc81d43b394dde2a74ff572a9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:05.192703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced74c-d42f-44e5-bddc-1884ac078e8a service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:05.217194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced74c-d42f-44e5-bddc-1884ac078e8a service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:05.341783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd91474-61fc-4d44-b92e-48282ded5c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:05.342427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91474-61fc-4d44-b92e-48282ded5c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:05.342700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91474-61fc-4d44-b92e-48282ded5c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:05.343006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91474-61fc-4d44-b92e-48282ded5c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:05.343655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd91474-61fc-4d44-b92e-48282ded5c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:05.345271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd91474-61fc-4d44-b92e-48282ded5c58 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:05.368864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 869/1727] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:05.372237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ff14-ddcb-4a32-8e52-50dd107340de admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:05.394639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ff14-ddcb-4a32-8e52-50dd107340de admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:05.422685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:05.423558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:05.424121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:05.424403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] PATH_INFO: `/v3/projects/c33bd252794e4f0e92f458cc2039ec3e/users/20694b4dc81d43b394dde2a74ff572a9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:05.432300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33bd252794e4f0e92f458cc2039ec3e, user_id=20694b4dc81d43b394dde2a74ff572a9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:05.448746 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:05.481728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 859/1728] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:05 2022] PUT /identity/v3/projects/c33bd252794e4f0e92f458cc2039ec3e/users/20694b4dc81d43b394dde2a74ff572a9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:05.492941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9994e-36f0-4ebb-a0f5-57eba0b8343a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:05.493938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9994e-36f0-4ebb-a0f5-57eba0b8343a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:05.494358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9994e-36f0-4ebb-a0f5-57eba0b8343a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:05.585653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8ef9994e-36f0-4ebb-a0f5-57eba0b8343a None None] MFA Rules not processed for user `20694b4dc81d43b394dde2a74ff572a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:05.589634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8ef9994e-36f0-4ebb-a0f5-57eba0b8343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:05.714618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:05.779881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:05.781044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 870/1729] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:05.783591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:05.905066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5a90-92a7-4d7a-a608-075d9164e73d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:05.918696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b1065-e00a-4dc8-a706-30ddd8d139c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:05.919256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1065-e00a-4dc8-a706-30ddd8d139c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:05.919530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1065-e00a-4dc8-a706-30ddd8d139c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:05.919836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1065-e00a-4dc8-a706-30ddd8d139c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:05.948015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b1065-e00a-4dc8-a706-30ddd8d139c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:05.949592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b1065-e00a-4dc8-a706-30ddd8d139c8 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:05.967329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 860/1730] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:06.114274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9994e-36f0-4ebb-a0f5-57eba0b8343a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:06.132755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9994e-36f0-4ebb-a0f5-57eba0b8343a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:06.140869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:06.142414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:06.143249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:06.143624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:06.145956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:06.283775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:06.286940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:06.313338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 871/1731] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:06.510153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9c630-8308-4782-a3b2-70cbc7ef2941 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:06.510430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9c630-8308-4782-a3b2-70cbc7ef2941 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:06.510907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9c630-8308-4782-a3b2-70cbc7ef2941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:06.590824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9ff9c630-8308-4782-a3b2-70cbc7ef2941 None None] MFA Rules not processed for user `e5cce01c978f43029c17fd696e1a2bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:06.592877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9ff9c630-8308-4782-a3b2-70cbc7ef2941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:06.767164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:06.768669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:06.784704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 861/1732] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:06.796228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9c630-8308-4782-a3b2-70cbc7ef2941 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:06.797799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9ff9c630-8308-4782-a3b2-70cbc7ef2941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:06.957416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64d08-f2fb-4cd7-bbce-c3fe0e1ce64e service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:06.986240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:06.986240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:06.986240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:06.986240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] PATH_INFO: `/v3/projects/95d0415f4ad04890ad028d8976f19cfd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:06.988424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d0415f4ad04890ad028d8976f19cfd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:06.996637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:07.084088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9c630-8308-4782-a3b2-70cbc7ef2941 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:07.111790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad10c40-1f68-4384-a6df-c74954149308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:07.116168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10c40-1f68-4384-a6df-c74954149308 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:07.116457 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10c40-1f68-4384-a6df-c74954149308 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:07.116736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad10c40-1f68-4384-a6df-c74954149308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:07.141773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d0415f4ad04890ad028d8976f19cfd', 'request_id': 'req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.163785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d0415f4ad04890ad028d8976f19cfd', 'request_id': 'req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.173531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:07.183633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d0415f4ad04890ad028d8976f19cfd', 'request_id': 'req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.185523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad10c40-1f68-4384-a6df-c74954149308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:07.192930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad10c40-1f68-4384-a6df-c74954149308 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:07.222133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] The token cache is being invalidate because project 95d0415f4ad04890ad028d8976f19cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:07.222523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.225232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.235477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 862/1734] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:07.237310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 872/1734] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:06 2022] DELETE /identity/v3/projects/95d0415f4ad04890ad028d8976f19cfd => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:07.239067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:07.241336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:07.241978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2e25-146b-4675-b4a4-865eba974421 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:07.244821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2e25-146b-4675-b4a4-865eba974421 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:07.245284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2e25-146b-4675-b4a4-865eba974421 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:07.252347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 863/1735] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:01:07 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:01:07.313838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:07.482896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4ab59-e54e-4b3d-94e9-bf59f9f1aa26 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:07.497954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:07.499469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:07.501902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:07.502301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] PATH_INFO: `/v3/users/c80ab49dea5a45d4b625500f7b1d13a3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:07.519447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80ab49dea5a45d4b625500f7b1d13a3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:07.520093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43793-f34b-4e71-b11a-a98de1798386 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:07.522507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43793-f34b-4e71-b11a-a98de1798386 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:07.522895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43793-f34b-4e71-b11a-a98de1798386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:07.532385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:07.586424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fee43793-f34b-4e71-b11a-a98de1798386 None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:07.595672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fee43793-f34b-4e71-b11a-a98de1798386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:07.693483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80ab49dea5a45d4b625500f7b1d13a3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.725427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80ab49dea5a45d4b625500f7b1d13a3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.729660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80ab49dea5a45d4b625500f7b1d13a3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.736331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80ab49dea5a45d4b625500f7b1d13a3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.763206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80ab49dea5a45d4b625500f7b1d13a3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:07.816822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 873/1736] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:07 2022] DELETE /identity/v3/users/c80ab49dea5a45d4b625500f7b1d13a3 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:07.818862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:07.823905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:07.861893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 864/1737] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:01:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:07.910330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909ff3-f2b0-4991-baff-737b07ccebb4 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:07.910618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909ff3-f2b0-4991-baff-737b07ccebb4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:07.910971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909ff3-f2b0-4991-baff-737b07ccebb4 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:07.912494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 865/1738] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 24 05:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 05:01:07.925886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758f69-101d-411b-b187-5cb1428fae00 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:07.925886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758f69-101d-411b-b187-5cb1428fae00 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:07.926036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758f69-101d-411b-b187-5cb1428fae00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:07.987798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c3758f69-101d-411b-b187-5cb1428fae00 None None] MFA Rules not processed for user `fe631741e1344f08a139c497b5645383`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:07.989055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c3758f69-101d-411b-b187-5cb1428fae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:08.137438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca26202-295d-4e28-bbbe-d63b08cb99c4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:08.162265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3b74-6ac3-4dea-888c-4dadd06ee167 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:08.164589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3b74-6ac3-4dea-888c-4dadd06ee167 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:08.165094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3b74-6ac3-4dea-888c-4dadd06ee167 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:08.165370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3b74-6ac3-4dea-888c-4dadd06ee167 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:08.169693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bd3c3b74-6ac3-4dea-888c-4dadd06ee167 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:08.201317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 866/1739] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 24 05:01:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:08.204496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3758f69-101d-411b-b187-5cb1428fae00 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:08.211852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c3758f69-101d-411b-b187-5cb1428fae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:08.216696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3b74-6ac3-4dea-888c-4dadd06ee167 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:08.218783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3b74-6ac3-4dea-888c-4dadd06ee167 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:08.246898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 874/1740] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:08.250704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96962459-2067-4c2a-a4e5-64a0ff23c8f1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:08.251496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96962459-2067-4c2a-a4e5-64a0ff23c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:08.251496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96962459-2067-4c2a-a4e5-64a0ff23c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:08.314023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-96962459-2067-4c2a-a4e5-64a0ff23c8f1 None None] MFA Rules not processed for user `cd5ac67dae69446eb8695af69daa439f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:08.318269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-96962459-2067-4c2a-a4e5-64a0ff23c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:08.414516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:08.426533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3758f69-101d-411b-b187-5cb1428fae00 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:08.441951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:08.442732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:08.443132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:08.444005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] PATH_INFO: `/v3/users/234e374459f54ae89898c834f4d65071` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:08.445327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=234e374459f54ae89898c834f4d65071)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:08.453282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:08.524353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 875/1741] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:08.526588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96962459-2067-4c2a-a4e5-64a0ff23c8f1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:08.586268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:08.610403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96962459-2067-4c2a-a4e5-64a0ff23c8f1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:08.650140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9b934-4fd4-44ea-9ea5-fa95e9c206f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:08.650796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9b934-4fd4-44ea-9ea5-fa95e9c206f4 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:08.651280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9b934-4fd4-44ea-9ea5-fa95e9c206f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:08.659534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9b934-4fd4-44ea-9ea5-fa95e9c206f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:08.663697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234e374459f54ae89898c834f4d65071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:08.695210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234e374459f54ae89898c834f4d65071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:08.696093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234e374459f54ae89898c834f4d65071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:08.700536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234e374459f54ae89898c834f4d65071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:08.704140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9b934-4fd4-44ea-9ea5-fa95e9c206f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:08.712154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9b934-4fd4-44ea-9ea5-fa95e9c206f4 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:08.739439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8c5e566d-59d0-45f0-8942-ea4588544752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234e374459f54ae89898c834f4d65071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:08.762839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 876/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:08.765076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d018f5-5d8b-491d-b5da-5580c79df3b9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:08.765368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d018f5-5d8b-491d-b5da-5580c79df3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:08.765637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d018f5-5d8b-491d-b5da-5580c79df3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:08.802949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 867/1743] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:08 2022] DELETE /identity/v3/users/234e374459f54ae89898c834f4d65071 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:08.934769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-58d018f5-5d8b-491d-b5da-5580c79df3b9 None None] MFA Rules not processed for user `af82c99ccd584433bdff0b6ba2499ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:08.937705 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58d018f5-5d8b-491d-b5da-5580c79df3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:09.227245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 877/1744] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:09.243203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae14c-c1dd-4d53-86ad-e4e918756ae5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:09.243783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae14c-c1dd-4d53-86ad-e4e918756ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:09.243783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae14c-c1dd-4d53-86ad-e4e918756ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:09.304960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d018f5-5d8b-491d-b5da-5580c79df3b9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:09.307262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58d018f5-5d8b-491d-b5da-5580c79df3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:09.325760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-288ae14c-c1dd-4d53-86ad-e4e918756ae5 None None] MFA Rules not processed for user `af82c99ccd584433bdff0b6ba2499ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:09.327044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-288ae14c-c1dd-4d53-86ad-e4e918756ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:09.393312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 868/1745] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:09.405809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ae14c-c1dd-4d53-86ad-e4e918756ae5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:09.408831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-288ae14c-c1dd-4d53-86ad-e4e918756ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:09.611757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d018f5-5d8b-491d-b5da-5580c79df3b9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:09.648332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:09.649691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:09.651759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:09.652242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] PATH_INFO: `/v3/projects/6847706aa4b04fe8948bd81dd4cd9a03` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:09.655905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6847706aa4b04fe8948bd81dd4cd9a03)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:09.661560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:09.698582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ae14c-c1dd-4d53-86ad-e4e918756ae5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:09.718104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a60d-6251-4190-a8df-340f7d684c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:09.718967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a60d-6251-4190-a8df-340f7d684c6f service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:09.724489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a60d-6251-4190-a8df-340f7d684c6f service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:09.725103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a60d-6251-4190-a8df-340f7d684c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:09.760202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a60d-6251-4190-a8df-340f7d684c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:09.762393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a60d-6251-4190-a8df-340f7d684c6f service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:09.802315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 869/1746] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:09.838650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:09.848055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6847706aa4b04fe8948bd81dd4cd9a03', 'request_id': 'req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:09.885021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6847706aa4b04fe8948bd81dd4cd9a03', 'request_id': 'req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:09.919270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6847706aa4b04fe8948bd81dd4cd9a03', 'request_id': 'req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:09.962948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] The token cache is being invalidate because project 6847706aa4b04fe8948bd81dd4cd9a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:09.963537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:09.967272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90a2b0a4-80d5-47bb-ab64-3b8cd4c6a532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:09.972438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 878/1747] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:09 2022] DELETE /identity/v3/projects/6847706aa4b04fe8948bd81dd4cd9a03 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:09.976716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a60d-6251-4190-a8df-340f7d684c6f service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:09.998966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a60d-6251-4190-a8df-340f7d684c6f service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:10.026740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c79cb4-0714-4b55-8213-53236b364098 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:10.027170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c79cb4-0714-4b55-8213-53236b364098 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:10.027345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c79cb4-0714-4b55-8213-53236b364098 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:10.029272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 879/1748] 10.222.0.26 () {54 vars in 912 bytes} [Sat Sep 24 05:01:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:01:10.029855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c79cb4-0714-4b55-8213-53236b364098 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:10.032930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-12c79cb4-0714-4b55-8213-53236b364098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:10.262662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:10.264415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:10.272635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:10.273257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] PATH_INFO: `/v3/users/084c096dbb804b6888d26c681ed81595` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:10.279809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084c096dbb804b6888d26c681ed81595)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:10.288979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:10.311651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c79cb4-0714-4b55-8213-53236b364098 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:10.324124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:10.325547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:10.327112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:10.328189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] PATH_INFO: `/v3/projects/ec8da0aeecc94a79a79d4e02e971d429` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:10.334837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8da0aeecc94a79a79d4e02e971d429)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:10.340717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:10.380447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:10.438532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084c096dbb804b6888d26c681ed81595'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.458402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084c096dbb804b6888d26c681ed81595'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.459539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084c096dbb804b6888d26c681ed81595'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.460591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084c096dbb804b6888d26c681ed81595'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.495872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8da0aeecc94a79a79d4e02e971d429', 'request_id': 'req-e07ea32e-c61a-4540-8205-8567821147a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.499287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c1829b2d-48f5-4a99-82b0-88c90c917a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084c096dbb804b6888d26c681ed81595'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.508166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8da0aeecc94a79a79d4e02e971d429', 'request_id': 'req-e07ea32e-c61a-4540-8205-8567821147a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.530169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8da0aeecc94a79a79d4e02e971d429', 'request_id': 'req-e07ea32e-c61a-4540-8205-8567821147a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.554346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 870/1749] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:09 2022] DELETE /identity/v3/users/084c096dbb804b6888d26c681ed81595 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:10.557003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c18e-51c2-4981-ad18-57d9b17a07c2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:10.557290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c18e-51c2-4981-ad18-57d9b17a07c2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:10.560139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c18e-51c2-4981-ad18-57d9b17a07c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:10.569078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] The token cache is being invalidate because project ec8da0aeecc94a79a79d4e02e971d429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:10.569360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.573262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e07ea32e-c61a-4540-8205-8567821147a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:10.579068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 880/1750] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:10 2022] DELETE /identity/v3/projects/ec8da0aeecc94a79a79d4e02e971d429 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:10.584099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21267805-1f3d-4f06-b39e-1e5e8f815f5e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:10.584373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21267805-1f3d-4f06-b39e-1e5e8f815f5e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:10.588239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21267805-1f3d-4f06-b39e-1e5e8f815f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:10.655900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2ad2c18e-51c2-4981-ad18-57d9b17a07c2 None None] MFA Rules not processed for user `f50dc809ff034866a1f6343e5b32609b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:10.657345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2ad2c18e-51c2-4981-ad18-57d9b17a07c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:10.714825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-21267805-1f3d-4f06-b39e-1e5e8f815f5e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:10.723283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-21267805-1f3d-4f06-b39e-1e5e8f815f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:10.830713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 871/1751] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:10.865924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2c18e-51c2-4981-ad18-57d9b17a07c2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:10.875417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2ad2c18e-51c2-4981-ad18-57d9b17a07c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:10.911278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2c18e-51c2-4981-ad18-57d9b17a07c2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:10.934928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe1917-e5e1-4d0b-823c-d0cc3c399d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:10.934928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe1917-e5e1-4d0b-823c-d0cc3c399d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:10.934928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe1917-e5e1-4d0b-823c-d0cc3c399d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:10.934928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe1917-e5e1-4d0b-823c-d0cc3c399d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:10.966701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe1917-e5e1-4d0b-823c-d0cc3c399d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:10.966934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 881/1752] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:10.967989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe1917-e5e1-4d0b-823c-d0cc3c399d18 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:10.974985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714b6e-79ba-4b2f-96d1-9e9bf40beea0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:10.975356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714b6e-79ba-4b2f-96d1-9e9bf40beea0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:10.975523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714b6e-79ba-4b2f-96d1-9e9bf40beea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:11.017472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 872/1753] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:11.049063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:11.063802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dd714b6e-79ba-4b2f-96d1-9e9bf40beea0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:11.073325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dd714b6e-79ba-4b2f-96d1-9e9bf40beea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:11.110842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 882/1754] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:11.112404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe1917-e5e1-4d0b-823c-d0cc3c399d18 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:11.140687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe1917-e5e1-4d0b-823c-d0cc3c399d18 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:11.181643 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:11.182200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:11.182493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:11.182782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:11.187770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:11.188100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:11.189755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:11.266809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 873/1755] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:11.270745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714b6e-79ba-4b2f-96d1-9e9bf40beea0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:11.300493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714b6e-79ba-4b2f-96d1-9e9bf40beea0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:11.323101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b79c4-580b-40f4-a0d2-bcbcf181a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:11.323980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b79c4-580b-40f4-a0d2-bcbcf181a61f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:11.324967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b79c4-580b-40f4-a0d2-bcbcf181a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:11.325383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b79c4-580b-40f4-a0d2-bcbcf181a61f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:11.326166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b79c4-580b-40f4-a0d2-bcbcf181a61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:11.332145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b79c4-580b-40f4-a0d2-bcbcf181a61f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:11.389416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:11.391176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:11.411471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 883/1756] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:11 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:11.416903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b79c4-580b-40f4-a0d2-bcbcf181a61f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:11.439779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d2fff-fdd2-4199-b0ff-01f71e021920 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:11.600004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b79c4-580b-40f4-a0d2-bcbcf181a61f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:11.611578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2c125-5a92-4fdb-8c39-4388d5e29ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:11.612206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2c125-5a92-4fdb-8c39-4388d5e29ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:11.614660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2c125-5a92-4fdb-8c39-4388d5e29ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:11.614985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2c125-5a92-4fdb-8c39-4388d5e29ebe admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:11.616171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2c125-5a92-4fdb-8c39-4388d5e29ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:11.624213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2c125-5a92-4fdb-8c39-4388d5e29ebe admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:11.686349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:11.689102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:11.690443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:11.696120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] PATH_INFO: `/v3/projects/a9ed512fe4924ac88e2f2e2a7d1138fb` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:11.697972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ed512fe4924ac88e2f2e2a7d1138fb)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:11.709076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 884/1757] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:11 2022] POST /identity/v3/users => generated 292 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:11.711248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:11.721836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2c125-5a92-4fdb-8c39-4388d5e29ebe admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:11.769194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2c125-5a92-4fdb-8c39-4388d5e29ebe admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:11.783953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf366b8-781a-4316-b9fd-9633911062e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:11.789546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf366b8-781a-4316-b9fd-9633911062e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:11.789546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf366b8-781a-4316-b9fd-9633911062e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:11.789546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf366b8-781a-4316-b9fd-9633911062e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:11.789892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf366b8-781a-4316-b9fd-9633911062e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:11.797240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf366b8-781a-4316-b9fd-9633911062e4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:11.831568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 885/1758] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:11.839494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf366b8-781a-4316-b9fd-9633911062e4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:11.866431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:11.901852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf366b8-781a-4316-b9fd-9633911062e4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:11.916461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ed512fe4924ac88e2f2e2a7d1138fb', 'request_id': 'req-2978e81a-81a3-40bd-9d46-7e2318674736'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:11.936082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ed512fe4924ac88e2f2e2a7d1138fb', 'request_id': 'req-2978e81a-81a3-40bd-9d46-7e2318674736'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:11.959424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ed512fe4924ac88e2f2e2a7d1138fb', 'request_id': 'req-2978e81a-81a3-40bd-9d46-7e2318674736'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:11.992000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] The token cache is being invalidate because project a9ed512fe4924ac88e2f2e2a7d1138fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:11.992176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:12.003552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2978e81a-81a3-40bd-9d46-7e2318674736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:12.010928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 874/1759] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:11 2022] DELETE /identity/v3/projects/a9ed512fe4924ac88e2f2e2a7d1138fb => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:12.012757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50276-2b04-4b35-bc36-e002958d2d9d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:12.013054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50276-2b04-4b35-bc36-e002958d2d9d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:12.013334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50276-2b04-4b35-bc36-e002958d2d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:12.080932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d7a50276-2b04-4b35-bc36-e002958d2d9d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:12.083231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d7a50276-2b04-4b35-bc36-e002958d2d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:12.253617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:12.257997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:12.258264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:12.263114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:12.263934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:12.274790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:12.341588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 886/1760] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:12.343052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:12.348347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:12.382259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 875/1761] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:12.407027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724aa2-7f42-4455-b179-64cd4174db82 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:12.407988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724aa2-7f42-4455-b179-64cd4174db82 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:12.410130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724aa2-7f42-4455-b179-64cd4174db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:12.412005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b540-2cf8-46ad-adcd-efc24ff69a07 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:12.427707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4934-a5a8-41b2-b41e-e4d2838a4ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:12.428835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4934-a5a8-41b2-b41e-e4d2838a4ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:12.430895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4934-a5a8-41b2-b41e-e4d2838a4ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:12.432804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4934-a5a8-41b2-b41e-e4d2838a4ac4 admin admin] PATH_INFO: `/v3/projects/1b73f6ba1310445d87d9e6479a1f32a3/users/1d85f992cb9240d39590201e2d6bafea/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:12.476561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-76724aa2-7f42-4455-b179-64cd4174db82 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:12.478197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-76724aa2-7f42-4455-b179-64cd4174db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:12.482812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4934-a5a8-41b2-b41e-e4d2838a4ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b73f6ba1310445d87d9e6479a1f32a3, user_id=1d85f992cb9240d39590201e2d6bafea, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:12.487815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4934-a5a8-41b2-b41e-e4d2838a4ac4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:12.504763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 876/1762] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:12.505915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76724aa2-7f42-4455-b179-64cd4174db82 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:12.528542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 887/1763] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:12 2022] PUT /identity/v3/projects/1b73f6ba1310445d87d9e6479a1f32a3/users/1d85f992cb9240d39590201e2d6bafea/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:12.542429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701819f-1fc2-4dea-b5e1-e5f9fa79f0aa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:12.542777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701819f-1fc2-4dea-b5e1-e5f9fa79f0aa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:12.543138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701819f-1fc2-4dea-b5e1-e5f9fa79f0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:12.544363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76724aa2-7f42-4455-b179-64cd4174db82 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:12.610204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a701819f-1fc2-4dea-b5e1-e5f9fa79f0aa None None] MFA Rules not processed for user `1d85f992cb9240d39590201e2d6bafea`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:12.612603 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a701819f-1fc2-4dea-b5e1-e5f9fa79f0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:12.675720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:12.834890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dcf09-64ea-421b-b454-543d08bd167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:12.836695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dcf09-64ea-421b-b454-543d08bd167d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:12.843404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dcf09-64ea-421b-b454-543d08bd167d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:12.843898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dcf09-64ea-421b-b454-543d08bd167d admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:12.844818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dcf09-64ea-421b-b454-543d08bd167d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:12.845293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dcf09-64ea-421b-b454-543d08bd167d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:12.854307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dcf09-64ea-421b-b454-543d08bd167d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:12.878138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 877/1764] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:12.884718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7253-2a39-4c59-803a-b2b907cca4c3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:12.891042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7253-2a39-4c59-803a-b2b907cca4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:12.891466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7253-2a39-4c59-803a-b2b907cca4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:12.909223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 888/1765] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:12.917003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701819f-1fc2-4dea-b5e1-e5f9fa79f0aa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:12.935540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701819f-1fc2-4dea-b5e1-e5f9fa79f0aa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:12.944279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d36888-7717-490e-b2b1-e377a02e788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:12.945106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d36888-7717-490e-b2b1-e377a02e788f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:12.945388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d36888-7717-490e-b2b1-e377a02e788f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:12.945660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d36888-7717-490e-b2b1-e377a02e788f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:12.962226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d36888-7717-490e-b2b1-e377a02e788f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:12.968812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d36888-7717-490e-b2b1-e377a02e788f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:13.030076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 889/1766] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:12 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:13.032544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d36888-7717-490e-b2b1-e377a02e788f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:13.040656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c9be7253-2a39-4c59-803a-b2b907cca4c3 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:13.044501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c9be7253-2a39-4c59-803a-b2b907cca4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:13.100539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:13.241654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 878/1767] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:01:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:13.243536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be7253-2a39-4c59-803a-b2b907cca4c3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:13.266175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be7253-2a39-4c59-803a-b2b907cca4c3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:13.284603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45fff-701b-4f25-b1b5-2a226905e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:13.285874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45fff-701b-4f25-b1b5-2a226905e8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:13.286251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45fff-701b-4f25-b1b5-2a226905e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:13.286624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45fff-701b-4f25-b1b5-2a226905e8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:13.288679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d45fff-701b-4f25-b1b5-2a226905e8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:13.291334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d36888-7717-490e-b2b1-e377a02e788f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:13.293118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d45fff-701b-4f25-b1b5-2a226905e8b1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:13.308236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527803c0-7aba-426b-a7ce-67461513004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:13.310318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527803c0-7aba-426b-a7ce-67461513004c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:13.310707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527803c0-7aba-426b-a7ce-67461513004c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:13.314100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527803c0-7aba-426b-a7ce-67461513004c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:13.315072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527803c0-7aba-426b-a7ce-67461513004c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:13.320185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527803c0-7aba-426b-a7ce-67461513004c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:13.407693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 879/1768] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:13 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:13.409783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45fff-701b-4f25-b1b5-2a226905e8b1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:13.435974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45fff-701b-4f25-b1b5-2a226905e8b1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:13.446111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 890/1769] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:13 2022] POST /identity/v3/projects => generated 383 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:13.449823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d8b1-2f82-4dc7-84da-868576c4c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:13.450824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d8b1-2f82-4dc7-84da-868576c4c4ca admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:13.451173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527803c0-7aba-426b-a7ce-67461513004c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:13.451428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d8b1-2f82-4dc7-84da-868576c4c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:13.452064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d8b1-2f82-4dc7-84da-868576c4c4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:13.453303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617d8b1-2f82-4dc7-84da-868576c4c4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:13.456106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617d8b1-2f82-4dc7-84da-868576c4c4ca admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:13.484154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 880/1770] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:13.485276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d8b1-2f82-4dc7-84da-868576c4c4ca admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:13.531371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d8b1-2f82-4dc7-84da-868576c4c4ca admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:13.667354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527803c0-7aba-426b-a7ce-67461513004c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:13.715078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:13.715078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:13.715078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:13.715078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:13.715486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:13.720310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:13.793353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 891/1771] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:13 2022] POST /identity/v3/users => generated 298 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:13.794358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:13.799200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:13.835570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:13.875425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0e645-f760-483b-b718-b6cef77e2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:13.877754 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0e645-f760-483b-b718-b6cef77e2b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:13.888349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0e645-f760-483b-b718-b6cef77e2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:13.888800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0e645-f760-483b-b718-b6cef77e2b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:13.889997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0e645-f760-483b-b718-b6cef77e2b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:13.895523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0e645-f760-483b-b718-b6cef77e2b3a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:13.925442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 881/1772] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:13.927813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0e645-f760-483b-b718-b6cef77e2b3a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:13.958642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0e645-f760-483b-b718-b6cef77e2b3a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:13.975634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c07830-f5e5-42de-8111-6b83e58ccd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:13.976381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c07830-f5e5-42de-8111-6b83e58ccd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:13.976746 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c07830-f5e5-42de-8111-6b83e58ccd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:13.977146 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c07830-f5e5-42de-8111-6b83e58ccd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:13.978361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c07830-f5e5-42de-8111-6b83e58ccd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:13.988824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c07830-f5e5-42de-8111-6b83e58ccd9c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:14.021949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 882/1773] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:14.026643 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c07830-f5e5-42de-8111-6b83e58ccd9c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:14.031285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f3b-3889-449d-83ec-bf67c09771ad admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:14.052177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b3d5-899e-44eb-8c4a-b5fb5197f371 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:14.052962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b3d5-899e-44eb-8c4a-b5fb5197f371 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:14.053335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b3d5-899e-44eb-8c4a-b5fb5197f371 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:14.053735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b3d5-899e-44eb-8c4a-b5fb5197f371 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:14.060715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c07830-f5e5-42de-8111-6b83e58ccd9c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:14.077789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ace5d-d770-4871-a671-72d5c7584c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:14.080922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ace5d-d770-4871-a671-72d5c7584c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:14.081336 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ace5d-d770-4871-a671-72d5c7584c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:14.083729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ace5d-d770-4871-a671-72d5c7584c78 admin admin] PATH_INFO: `/v3/projects/5cdd15c7eb424e138654aa1597a3da46/users/72a8ef2366da409598d9a169ce3ea503/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:14.140542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ace5d-d770-4871-a671-72d5c7584c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdd15c7eb424e138654aa1597a3da46, user_id=72a8ef2366da409598d9a169ce3ea503, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:14.143387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ace5d-d770-4871-a671-72d5c7584c78 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:14.182546 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 883/1774] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:14 2022] PUT /identity/v3/projects/5cdd15c7eb424e138654aa1597a3da46/users/72a8ef2366da409598d9a169ce3ea503/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:14.183642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ace5d-d770-4871-a671-72d5c7584c78 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:14.281388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4b3d5-899e-44eb-8c4a-b5fb5197f371 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:14.283087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4b3d5-899e-44eb-8c4a-b5fb5197f371 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:14.306039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 892/1775] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:01:14.322625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143376be-acca-42bb-b2eb-7281844fdc41 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:14.322976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143376be-acca-42bb-b2eb-7281844fdc41 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:14.323212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143376be-acca-42bb-b2eb-7281844fdc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:14.355344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:14.410538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ace5d-d770-4871-a671-72d5c7584c78 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:14.434425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cbda7-378d-4201-ba91-17a16aac20b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:14.438801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cbda7-378d-4201-ba91-17a16aac20b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:14.439774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-143376be-acca-42bb-b2eb-7281844fdc41 None None] MFA Rules not processed for user `e5cce01c978f43029c17fd696e1a2bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:14.441790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cbda7-378d-4201-ba91-17a16aac20b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:14.451259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cbda7-378d-4201-ba91-17a16aac20b1 admin admin] PATH_INFO: `/v3/projects/a707d978f32d436393cd9fa880e9d69c/users/923dec4601a0434daf3f7bb700f310e4/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:14.470889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-143376be-acca-42bb-b2eb-7281844fdc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:14.537410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cbda7-378d-4201-ba91-17a16aac20b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a707d978f32d436393cd9fa880e9d69c, user_id=923dec4601a0434daf3f7bb700f310e4, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:14.540917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cbda7-378d-4201-ba91-17a16aac20b1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:14.625750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 884/1776] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:14 2022] PUT /identity/v3/projects/a707d978f32d436393cd9fa880e9d69c/users/923dec4601a0434daf3f7bb700f310e4/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:14.633823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5a6ef-618e-46cf-9491-545a85069819 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:14.634192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5a6ef-618e-46cf-9491-545a85069819 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:14.643257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5a6ef-618e-46cf-9491-545a85069819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:14.733492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 893/1777] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:14.737829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143376be-acca-42bb-b2eb-7281844fdc41 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:14.769963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143376be-acca-42bb-b2eb-7281844fdc41 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:14.802418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3da5a6ef-618e-46cf-9491-545a85069819 None None] MFA Rules not processed for user `72a8ef2366da409598d9a169ce3ea503`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:14.805112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3da5a6ef-618e-46cf-9491-545a85069819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:14.922019 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:15.056658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:15.065718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:15.065904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:15.066139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:15.066919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:15.075849 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:15.124088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 894/1778] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:15.124301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:15.134264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:15.175157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 885/1779] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 549 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:15.176099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5a6ef-618e-46cf-9491-545a85069819 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:15.195140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3501607-27ac-4d8d-a945-270eef1f9c0f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:15.208306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:15.208801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:15.209079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:15.209358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] PATH_INFO: `/v3/users/e7b6010b22e24c3a9f4bbda08e3eb643` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:15.214041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5a6ef-618e-46cf-9491-545a85069819 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:15.215635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b6010b22e24c3a9f4bbda08e3eb643)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:15.218042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:15.229784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244f19-7099-4671-88f1-91bf2bfa808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:15.232788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244f19-7099-4671-88f1-91bf2bfa808b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:15.233132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244f19-7099-4671-88f1-91bf2bfa808b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:15.233413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244f19-7099-4671-88f1-91bf2bfa808b admin admin] PATH_INFO: `/v3/projects/a707d978f32d436393cd9fa880e9d69c/users/923dec4601a0434daf3f7bb700f310e4/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:15.244677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8244f19-7099-4671-88f1-91bf2bfa808b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a707d978f32d436393cd9fa880e9d69c, user_id=923dec4601a0434daf3f7bb700f310e4, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:15.248753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8244f19-7099-4671-88f1-91bf2bfa808b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:15.295704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 886/1780] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:15 2022] PUT /identity/v3/projects/a707d978f32d436393cd9fa880e9d69c/users/923dec4601a0434daf3f7bb700f310e4/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:15.305029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244f19-7099-4671-88f1-91bf2bfa808b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:15.374035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b6010b22e24c3a9f4bbda08e3eb643'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:15.390424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b6010b22e24c3a9f4bbda08e3eb643'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:15.391173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b6010b22e24c3a9f4bbda08e3eb643'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:15.392923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b6010b22e24c3a9f4bbda08e3eb643'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:15.423649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e5c73e0-c318-466f-8f8a-0c6dd8c58a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b6010b22e24c3a9f4bbda08e3eb643'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:15.494608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 895/1781] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:15 2022] DELETE /identity/v3/users/e7b6010b22e24c3a9f4bbda08e3eb643 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:15.496120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ec5e-acdd-4819-8943-8f8ecd9598b3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:15.496404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ec5e-acdd-4819-8943-8f8ecd9598b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:15.496683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ec5e-acdd-4819-8943-8f8ecd9598b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:15.518563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244f19-7099-4671-88f1-91bf2bfa808b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:15.609018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7679ec5e-acdd-4819-8943-8f8ecd9598b3 None None] MFA Rules not processed for user `923dec4601a0434daf3f7bb700f310e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:15.624982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7679ec5e-acdd-4819-8943-8f8ecd9598b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:15.769542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:15.826392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa129c6a-125e-4ae0-8e36-5cccf85f0f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:15.826665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa129c6a-125e-4ae0-8e36-5cccf85f0f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:15.827123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa129c6a-125e-4ae0-8e36-5cccf85f0f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:15.827495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa129c6a-125e-4ae0-8e36-5cccf85f0f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:15.828243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa129c6a-125e-4ae0-8e36-5cccf85f0f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:15.841913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa129c6a-125e-4ae0-8e36-5cccf85f0f72 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:15.982779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 887/1782] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:15 2022] POST /identity/v3/projects => generated 393 bytes in 686 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:15.991469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1d59-1fb9-488f-9a90-28420d07f269 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:15.991759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1d59-1fb9-488f-9a90-28420d07f269 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:15.992039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1d59-1fb9-488f-9a90-28420d07f269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:16.052895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 896/1783] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 558 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:16.053830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679ec5e-acdd-4819-8943-8f8ecd9598b3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:16.058582 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7679ec5e-acdd-4819-8943-8f8ecd9598b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:16.077539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f5ab1d59-1fb9-488f-9a90-28420d07f269 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:16.078820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f5ab1d59-1fb9-488f-9a90-28420d07f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:16.120146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679ec5e-acdd-4819-8943-8f8ecd9598b3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:16.237930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:16.339600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 888/1784] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:16.341537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1d59-1fb9-488f-9a90-28420d07f269 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:16.352904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f5ab1d59-1fb9-488f-9a90-28420d07f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:16.378519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:16.387402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:16.389257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:16.389540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:16.390218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:16.401286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:16.481188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 897/1785] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:16 2022] POST /identity/v3/users => generated 303 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:16.489271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:16.494273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:16.692154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1d59-1fb9-488f-9a90-28420d07f269 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:16.710096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d6aa5-8eda-4b6e-8a41-2703b17dd990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:16.713906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6aa5-8eda-4b6e-8a41-2703b17dd990 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:16.714191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6aa5-8eda-4b6e-8a41-2703b17dd990 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:16.714467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6aa5-8eda-4b6e-8a41-2703b17dd990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:16.838866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff078c-e1e9-4378-a7d8-2d187e54e2b6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:16.862608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92826b73-96f2-4038-add7-3312363bdca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:16.863527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826b73-96f2-4038-add7-3312363bdca8 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:16.864922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826b73-96f2-4038-add7-3312363bdca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:16.865358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92826b73-96f2-4038-add7-3312363bdca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:16.962874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92826b73-96f2-4038-add7-3312363bdca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:16.964264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92826b73-96f2-4038-add7-3312363bdca8 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:16.977377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d6aa5-8eda-4b6e-8a41-2703b17dd990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:16.978983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d6aa5-8eda-4b6e-8a41-2703b17dd990 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:17.006193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 898/1786] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:17.019009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92826b73-96f2-4038-add7-3312363bdca8 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:17.026531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 889/1787] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:17.028171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c316-d84d-401d-b816-391cb2249905 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:17.028703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c316-d84d-401d-b816-391cb2249905 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:17.028985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c316-d84d-401d-b816-391cb2249905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:17.037757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92826b73-96f2-4038-add7-3312363bdca8 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:17.060557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c79f-825b-41de-ab7b-40e64a702e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:17.075710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c79f-825b-41de-ab7b-40e64a702e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:17.075999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c79f-825b-41de-ab7b-40e64a702e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:17.076277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c79f-825b-41de-ab7b-40e64a702e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:17.076959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c79f-825b-41de-ab7b-40e64a702e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:17.087555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c79f-825b-41de-ab7b-40e64a702e45 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:17.111574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6a27c316-d84d-401d-b816-391cb2249905 None None] MFA Rules not processed for user `f50dc809ff034866a1f6343e5b32609b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:17.112660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6a27c316-d84d-401d-b816-391cb2249905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:17.146679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 899/1788] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:17.155213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c79f-825b-41de-ab7b-40e64a702e45 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:17.168654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 890/1789] 10.222.0.55 () {58 vars in 1015 bytes} [Sat Sep 24 05:01:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:17.187631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c79f-825b-41de-ab7b-40e64a702e45 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:17.202974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051562a-0ae3-4d8a-aec3-030a04f57803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:17.203688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051562a-0ae3-4d8a-aec3-030a04f57803 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:17.203979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051562a-0ae3-4d8a-aec3-030a04f57803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:17.204281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051562a-0ae3-4d8a-aec3-030a04f57803 admin admin] PATH_INFO: `/v3/projects/65956194bdad4f949e296b58ec868bae/users/b349f081c5aa43ae86e225df5aa0a965/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:17.263377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051562a-0ae3-4d8a-aec3-030a04f57803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65956194bdad4f949e296b58ec868bae, user_id=b349f081c5aa43ae86e225df5aa0a965, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:17.272006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051562a-0ae3-4d8a-aec3-030a04f57803 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:17.298027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c316-d84d-401d-b816-391cb2249905 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:17.299589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6a27c316-d84d-401d-b816-391cb2249905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:17.311117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 900/1790] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:17 2022] PUT /identity/v3/projects/65956194bdad4f949e296b58ec868bae/users/b349f081c5aa43ae86e225df5aa0a965/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:17.311230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c316-d84d-401d-b816-391cb2249905 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:17.325964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051562a-0ae3-4d8a-aec3-030a04f57803 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:17.388501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:17.444070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:17.444831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:17.445298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:17.445785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:17.470507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:17.473138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:17.513796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 891/1791] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:17.533006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:17.540269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:17.607331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051562a-0ae3-4d8a-aec3-030a04f57803 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:17.639536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfd2b2-bf28-4a01-94ac-79cb48b8a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:17.640169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd2b2-bf28-4a01-94ac-79cb48b8a9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:17.640447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd2b2-bf28-4a01-94ac-79cb48b8a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:17.640731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd2b2-bf28-4a01-94ac-79cb48b8a9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:17.654957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfd2b2-bf28-4a01-94ac-79cb48b8a9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:17.670385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfd2b2-bf28-4a01-94ac-79cb48b8a9f4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:17.722088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 901/1792] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:17.723364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfd2b2-bf28-4a01-94ac-79cb48b8a9f4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:17.751788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfd2b2-bf28-4a01-94ac-79cb48b8a9f4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:17.816778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958710-2fdc-4279-945a-b4d70d10ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:17.818605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958710-2fdc-4279-945a-b4d70d10ce2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:17.818918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958710-2fdc-4279-945a-b4d70d10ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:17.819762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958710-2fdc-4279-945a-b4d70d10ce2c admin admin] PATH_INFO: `/v3/projects/65956194bdad4f949e296b58ec868bae/users/b349f081c5aa43ae86e225df5aa0a965/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:17.825753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7958710-2fdc-4279-945a-b4d70d10ce2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65956194bdad4f949e296b58ec868bae, user_id=b349f081c5aa43ae86e225df5aa0a965, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:17.837087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7958710-2fdc-4279-945a-b4d70d10ce2c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:17.885052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f062-f84f-4f05-a857-19c3c13c26b1 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:17.924319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 902/1793] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:17 2022] PUT /identity/v3/projects/65956194bdad4f949e296b58ec868bae/users/b349f081c5aa43ae86e225df5aa0a965/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:17.934904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4832f-8b40-4181-87c3-f16c7c05c097 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:17.935480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4832f-8b40-4181-87c3-f16c7c05c097 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:17.937109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4832f-8b40-4181-87c3-f16c7c05c097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:18.100130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:18.100130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:18.100130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:18.100130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:18.109976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:18.110917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:18.166520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fbb4832f-8b40-4181-87c3-f16c7c05c097 None None] MFA Rules not processed for user `b349f081c5aa43ae86e225df5aa0a965`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:18.174679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fbb4832f-8b40-4181-87c3-f16c7c05c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:18.352887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:18.358500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:18.385022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 903/1794] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:18.420124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 892/1795] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 906 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:18.706339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4832f-8b40-4181-87c3-f16c7c05c097 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:18.759415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4832f-8b40-4181-87c3-f16c7c05c097 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:18.784445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:18.790949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:18.791302 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:18.793358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:18.846341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:18.847919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:18.906591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 904/1796] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:19.127156 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:19.140282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984127c4-7b6f-46a3-ba9f-443e8aacde22 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:19.150557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:19.151286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:19.152233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:19.152707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:19.159780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:19.295627 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:19.396475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:19.398134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:19.443081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 893/1797] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:19.989345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:20.008235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:20.384851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ad3b2-5485-438a-9a52-a5c04ad6d00e service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:20.431546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:20.432233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:20.432521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:20.432775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] PATH_INFO: `/v3/projects/cc5b10c7cdf944cdbe343e21c7286a66` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:20.436756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5b10c7cdf944cdbe343e21c7286a66)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:20.442673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:20.702990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5b10c7cdf944cdbe343e21c7286a66', 'request_id': 'req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:20.723398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5b10c7cdf944cdbe343e21c7286a66', 'request_id': 'req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:20.745565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5b10c7cdf944cdbe343e21c7286a66', 'request_id': 'req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:20.785623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] The token cache is being invalidate because project cc5b10c7cdf944cdbe343e21c7286a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:20.785932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:20.789320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:20.795504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 905/1798] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:19 2022] DELETE /identity/v3/projects/cc5b10c7cdf944cdbe343e21c7286a66 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:20.799455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:20.829729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716b6e-f622-42a8-a6b8-a57c038cf010 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:21.118944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:21.122889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:21.123268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:21.124630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] PATH_INFO: `/v3/users/0dd6e49c9f0a42d892b98cbc328dd195` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:21.128660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd6e49c9f0a42d892b98cbc328dd195)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:21.140629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:21.306808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd6e49c9f0a42d892b98cbc328dd195'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:21.330063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd6e49c9f0a42d892b98cbc328dd195'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:21.331299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd6e49c9f0a42d892b98cbc328dd195'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:21.335171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd6e49c9f0a42d892b98cbc328dd195'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:21.368416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd6e49c9f0a42d892b98cbc328dd195'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:21.440264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 894/1799] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:20 2022] DELETE /identity/v3/users/0dd6e49c9f0a42d892b98cbc328dd195 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:23.048418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:23.049887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:23.075557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1b4e6-6031-4687-bc34-8c6a9741daf7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:23.122383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:23.345234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:23.346428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:23.347328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:23.348319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] PATH_INFO: `/v3/users/1d85f992cb9240d39590201e2d6bafea` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:23.350409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d85f992cb9240d39590201e2d6bafea)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:23.382571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:23.487102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:23.489405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:23.529083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cc889-69c8-4522-9bd6-1725b17b7a1f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:23.548243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d85f992cb9240d39590201e2d6bafea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.551677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:23.556107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:23.556408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:23.558306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] PATH_INFO: `/v3/projects/0d8fc56ec06848a994bba8d954cb7b15` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:23.568290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8fc56ec06848a994bba8d954cb7b15)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:23.578791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:23.587772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d85f992cb9240d39590201e2d6bafea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.593187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d85f992cb9240d39590201e2d6bafea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.595740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d85f992cb9240d39590201e2d6bafea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.623792 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bfb95293-f676-40d4-885b-56a79fb4ad82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d85f992cb9240d39590201e2d6bafea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.685909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 906/1800] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:23 2022] DELETE /identity/v3/users/1d85f992cb9240d39590201e2d6bafea => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:23.691766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac9b4-cb4c-4712-ab5e-cd55e724ebc3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:23.692049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac9b4-cb4c-4712-ab5e-cd55e724ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:23.692325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac9b4-cb4c-4712-ab5e-cd55e724ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:23.717883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-53dac9b4-cb4c-4712-ab5e-cd55e724ebc3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:23.719343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-53dac9b4-cb4c-4712-ab5e-cd55e724ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:23.793687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8fc56ec06848a994bba8d954cb7b15', 'request_id': 'req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.807683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:23.832219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8fc56ec06848a994bba8d954cb7b15', 'request_id': 'req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.866078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8fc56ec06848a994bba8d954cb7b15', 'request_id': 'req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.923757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] The token cache is being invalidate because project 0d8fc56ec06848a994bba8d954cb7b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:23.923757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.929372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-98f4063b-a4f2-41dd-8793-1c39dd5c69cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:23.939369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 907/1801] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:23.940586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 895/1802] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:23 2022] DELETE /identity/v3/projects/0d8fc56ec06848a994bba8d954cb7b15 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:23.947415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8877f-ba95-4f6b-973a-1f0729f80547 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:23.947788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8877f-ba95-4f6b-973a-1f0729f80547 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:23.948850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8877f-ba95-4f6b-973a-1f0729f80547 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:23.952603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9a44-69f7-43e8-8e6d-69a6c164ed2b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:23.953089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9a44-69f7-43e8-8e6d-69a6c164ed2b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:23.955674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 908/1803] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:01:23 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:01:23.956328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9a44-69f7-43e8-8e6d-69a6c164ed2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:23.960634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8877f-ba95-4f6b-973a-1f0729f80547 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:23.963307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d7f8877f-ba95-4f6b-973a-1f0729f80547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:24.027505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-398a9a44-69f7-43e8-8e6d-69a6c164ed2b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:24.030528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-398a9a44-69f7-43e8-8e6d-69a6c164ed2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:24.094878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:24.181117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8877f-ba95-4f6b-973a-1f0729f80547 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:24.191340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648e4dc-3996-4bb0-a630-2cc09e1b2bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:24.192275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e4dc-3996-4bb0-a630-2cc09e1b2bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:24.192761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e4dc-3996-4bb0-a630-2cc09e1b2bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:24.193383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e4dc-3996-4bb0-a630-2cc09e1b2bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:24.198040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4648e4dc-3996-4bb0-a630-2cc09e1b2bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:24.247178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 896/1804] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:24.251666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1390-5c46-430d-9c9d-d0e46b4b54e1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:24.251956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1390-5c46-430d-9c9d-d0e46b4b54e1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:24.252880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1390-5c46-430d-9c9d-d0e46b4b54e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:24.322454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0a6f1390-5c46-430d-9c9d-d0e46b4b54e1 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:24.335349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0a6f1390-5c46-430d-9c9d-d0e46b4b54e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:24.409057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648e4dc-3996-4bb0-a630-2cc09e1b2bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:24.411633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648e4dc-3996-4bb0-a630-2cc09e1b2bd0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:24.453531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 909/1805] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:24.455081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c33b4-58f1-4101-adb2-0bae275539dd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:24.457880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c33b4-58f1-4101-adb2-0bae275539dd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:24.458374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c33b4-58f1-4101-adb2-0bae275539dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:24.521408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-178c33b4-58f1-4101-adb2-0bae275539dd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:24.522724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-178c33b4-58f1-4101-adb2-0bae275539dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:24.544328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 910/1806] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:24.548742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c33b4-58f1-4101-adb2-0bae275539dd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:24.569417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c33b4-58f1-4101-adb2-0bae275539dd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:24.581893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 897/1807] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:01:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:24.584477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:24.585301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:24.585647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:24.586131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:24.586945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:24.587751 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:24.589637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:24.613937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 911/1808] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:24.620674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f1390-5c46-430d-9c9d-d0e46b4b54e1 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:24.637881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f1390-5c46-430d-9c9d-d0e46b4b54e1 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:24.652563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21daeb-0116-465b-96f5-68ecc069b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:24.653237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21daeb-0116-465b-96f5-68ecc069b5ef admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:24.653533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21daeb-0116-465b-96f5-68ecc069b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:24.653795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21daeb-0116-465b-96f5-68ecc069b5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:24.654580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21daeb-0116-465b-96f5-68ecc069b5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:24.665007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21daeb-0116-465b-96f5-68ecc069b5ef admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:24.720195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 898/1809] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:24 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:24.723762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:24.754162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450a4a-47de-4010-a316-2941785927b7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:24.910395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:24.912465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:24.915669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:24.916127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:24.916925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:24.923978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:24.950743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2a7b-6f50-4250-8e14-61022be1ce68 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:24.951249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2a7b-6f50-4250-8e14-61022be1ce68 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:24.951545 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2a7b-6f50-4250-8e14-61022be1ce68 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:24.953461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 899/1810] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 05:01:24.976450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 912/1811] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:24 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:24.980953 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2a7b-6f50-4250-8e14-61022be1ce68 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:24.999313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2a7b-6f50-4250-8e14-61022be1ce68 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:25.029073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053fb36-a983-47fe-8288-5bf3acc25cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:25.029766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053fb36-a983-47fe-8288-5bf3acc25cea admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:25.030136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053fb36-a983-47fe-8288-5bf3acc25cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:25.030303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053fb36-a983-47fe-8288-5bf3acc25cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:25.030995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053fb36-a983-47fe-8288-5bf3acc25cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:25.034959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053fb36-a983-47fe-8288-5bf3acc25cea admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:25.051400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:25.053754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:25.062402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 900/1812] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:25.063966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053fb36-a983-47fe-8288-5bf3acc25cea admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:25.089724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053fb36-a983-47fe-8288-5bf3acc25cea admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:25.111672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8545fc8-ec1e-4ea6-af04-db04cf0208cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:25.112164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8545fc8-ec1e-4ea6-af04-db04cf0208cd admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:25.112481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8545fc8-ec1e-4ea6-af04-db04cf0208cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:25.113113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8545fc8-ec1e-4ea6-af04-db04cf0208cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:25.114550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8545fc8-ec1e-4ea6-af04-db04cf0208cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:25.116239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8545fc8-ec1e-4ea6-af04-db04cf0208cd admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:25.177441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 901/1813] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:25.178369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8545fc8-ec1e-4ea6-af04-db04cf0208cd admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:25.223346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8545fc8-ec1e-4ea6-af04-db04cf0208cd admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:25.247162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a5193-2076-4c08-9483-f34e0dd7de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:25.255846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a5193-2076-4c08-9483-f34e0dd7de14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:25.256162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a5193-2076-4c08-9483-f34e0dd7de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:25.256440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a5193-2076-4c08-9483-f34e0dd7de14 admin admin] PATH_INFO: `/v3/projects/ce689986bb60486db27b5a8faa2d71aa/users/8e02fd2f432b48c6991b2b46707b96a1/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:25.268196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:25.313752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a5193-2076-4c08-9483-f34e0dd7de14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce689986bb60486db27b5a8faa2d71aa, user_id=8e02fd2f432b48c6991b2b46707b96a1, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:25.316811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a5193-2076-4c08-9483-f34e0dd7de14 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:25.367057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 902/1814] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:25 2022] PUT /identity/v3/projects/ce689986bb60486db27b5a8faa2d71aa/users/8e02fd2f432b48c6991b2b46707b96a1/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:25.376339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2708ab-c5aa-4413-838d-0803ce04fb80 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:25.376339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2708ab-c5aa-4413-838d-0803ce04fb80 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:25.376582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2708ab-c5aa-4413-838d-0803ce04fb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:25.380581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025175a-771f-4826-a10b-c20c4245ca03 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:25.400044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:25.445463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6c2708ab-c5aa-4413-838d-0803ce04fb80 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:25.448183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6c2708ab-c5aa-4413-838d-0803ce04fb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:25.628943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 903/1815] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:01:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:25.630988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f908c6-1e39-47a7-8971-85e55770f79d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:25.632767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f908c6-1e39-47a7-8971-85e55770f79d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:25.633892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f908c6-1e39-47a7-8971-85e55770f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:25.740145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:25.740779 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:25.741605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:25.741605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:25.765278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-22f908c6-1e39-47a7-8971-85e55770f79d None None] MFA Rules not processed for user `8e02fd2f432b48c6991b2b46707b96a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:25.769524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:25.770958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-22f908c6-1e39-47a7-8971-85e55770f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:25.781562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:25.820919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 913/1816] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:25.825023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:25.832698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:26.033937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 904/1817] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:26.035176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f908c6-1e39-47a7-8971-85e55770f79d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:26.055022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ef866-b410-422d-8b51-e133f493376d service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:26.061594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f908c6-1e39-47a7-8971-85e55770f79d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:26.065498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:26.066151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:26.066430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:26.066703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] PATH_INFO: `/v3/projects/1b73f6ba1310445d87d9e6479a1f32a3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:26.068623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b73f6ba1310445d87d9e6479a1f32a3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:26.070679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:26.081333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ee06-8906-42b9-a91c-58d9d3d566d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:26.081967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ee06-8906-42b9-a91c-58d9d3d566d3 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:26.082246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ee06-8906-42b9-a91c-58d9d3d566d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:26.082544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ee06-8906-42b9-a91c-58d9d3d566d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:26.097579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7ee06-8906-42b9-a91c-58d9d3d566d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:26.099086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7ee06-8906-42b9-a91c-58d9d3d566d3 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:26.137788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 905/1818] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:26.138772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ee06-8906-42b9-a91c-58d9d3d566d3 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:26.175901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ee06-8906-42b9-a91c-58d9d3d566d3 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:26.191634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b73f6ba1310445d87d9e6479a1f32a3', 'request_id': 'req-a76596b2-8a86-4d9c-8a81-b611f2208964'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.210047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b73f6ba1310445d87d9e6479a1f32a3', 'request_id': 'req-a76596b2-8a86-4d9c-8a81-b611f2208964'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.233150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b73f6ba1310445d87d9e6479a1f32a3', 'request_id': 'req-a76596b2-8a86-4d9c-8a81-b611f2208964'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.250424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] The token cache is being invalidate because project 1b73f6ba1310445d87d9e6479a1f32a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:26.251791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.253282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.259081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 914/1819] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:25 2022] DELETE /identity/v3/projects/1b73f6ba1310445d87d9e6479a1f32a3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:26.261465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:26.267785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:26.288679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:26.402046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76596b2-8a86-4d9c-8a81-b611f2208964 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:26.410985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:26.412273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:26.413209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:26.413693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] PATH_INFO: `/v3/users/72a8ef2366da409598d9a169ce3ea503` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:26.417838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a8ef2366da409598d9a169ce3ea503)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:26.422383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:26.423031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:26.423310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:26.423583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:26.424221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:26.424410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:26.426133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:26.495210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:26.517593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 906/1820] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:26 2022] POST /identity/v3/projects => generated 387 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:26.518766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:26.522027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:26.540437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a8ef2366da409598d9a169ce3ea503'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.559585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a8ef2366da409598d9a169ce3ea503'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.560367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a8ef2366da409598d9a169ce3ea503'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.573038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a8ef2366da409598d9a169ce3ea503'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.611315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a8ef2366da409598d9a169ce3ea503'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:26.691305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 915/1821] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:26 2022] DELETE /identity/v3/users/72a8ef2366da409598d9a169ce3ea503 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:26.693650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:26.712395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:26.778915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afac7e-4c80-4ec2-b38e-602a7d9123b9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:26.919037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccdf91-0ba8-4d6d-87e5-cfa3e9c06983 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:26.932886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3298fb-9c59-4b1b-9253-dbe0dee6ee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:26.933546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3298fb-9c59-4b1b-9253-dbe0dee6ee0a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:26.933836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3298fb-9c59-4b1b-9253-dbe0dee6ee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:26.934115 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3298fb-9c59-4b1b-9253-dbe0dee6ee0a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:26.938083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3298fb-9c59-4b1b-9253-dbe0dee6ee0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:26.944970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3298fb-9c59-4b1b-9253-dbe0dee6ee0a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:26.994951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:26.995625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:26.995906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:26.996185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] PATH_INFO: `/v3/users/923dec4601a0434daf3f7bb700f310e4` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:27.001346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923dec4601a0434daf3f7bb700f310e4)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:27.004132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:27.019699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 916/1822] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:26 2022] POST /identity/v3/users => generated 300 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:27.022590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5978-c162-4145-a86f-fbd492d0a904 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:27.025279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5978-c162-4145-a86f-fbd492d0a904 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:27.026357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5978-c162-4145-a86f-fbd492d0a904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:27.089732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-182a5978-c162-4145-a86f-fbd492d0a904 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:27.092343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-182a5978-c162-4145-a86f-fbd492d0a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:27.111888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923dec4601a0434daf3f7bb700f310e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:27.116198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 917/1823] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:27.116198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a5978-c162-4145-a86f-fbd492d0a904 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:27.135958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923dec4601a0434daf3f7bb700f310e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:27.136419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923dec4601a0434daf3f7bb700f310e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:27.137074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923dec4601a0434daf3f7bb700f310e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:27.142121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a5978-c162-4145-a86f-fbd492d0a904 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:27.148724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923dec4601a0434daf3f7bb700f310e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:27.156047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:27.156971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:27.157558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:27.158063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:27.159199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:27.162523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:27.171354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:27.201856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 918/1825] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:27.209118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 907/1825] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:26 2022] DELETE /identity/v3/users/923dec4601a0434daf3f7bb700f310e4 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:27.210367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:27.213622 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:27.213918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:27.222965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:27.295362 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:27.384063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0f056-0718-40a4-a9fe-24364c9b99e6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:27.402945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f7fd-5fda-4083-9612-beee09577722 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:27.413679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676f061-0a1e-4a35-aad0-c3f4d6ffdd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:27.416377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676f061-0a1e-4a35-aad0-c3f4d6ffdd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:27.418333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676f061-0a1e-4a35-aad0-c3f4d6ffdd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:27.419714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676f061-0a1e-4a35-aad0-c3f4d6ffdd1f admin admin] PATH_INFO: `/v3/projects/141b161755f94b12ac129e1ba2a328ac/users/36b30251def040939490b96f3a94e2b3/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:27.482774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:27.484604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:27.485764 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:27.486453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676f061-0a1e-4a35-aad0-c3f4d6ffdd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=141b161755f94b12ac129e1ba2a328ac, user_id=36b30251def040939490b96f3a94e2b3, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:27.486802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:27.489268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:27.492784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676f061-0a1e-4a35-aad0-c3f4d6ffdd1f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:27.513436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:27.516292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:27.523348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 908/1826] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:27 2022] PUT /identity/v3/projects/141b161755f94b12ac129e1ba2a328ac/users/36b30251def040939490b96f3a94e2b3/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:27.527990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676f061-0a1e-4a35-aad0-c3f4d6ffdd1f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:27.542221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 919/1827] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:27.780613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676f061-0a1e-4a35-aad0-c3f4d6ffdd1f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:27.796790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b0199-a8d9-4fdc-9436-edbf59c03761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:27.797344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b0199-a8d9-4fdc-9436-edbf59c03761 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:27.797624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b0199-a8d9-4fdc-9436-edbf59c03761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:27.797896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b0199-a8d9-4fdc-9436-edbf59c03761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:27.798549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b0199-a8d9-4fdc-9436-edbf59c03761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:27.800187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b0199-a8d9-4fdc-9436-edbf59c03761 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:27.831496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 909/1828] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:27.835560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:27.850681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6152158-d73b-465d-a85b-a64f482fadb2 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:27.867000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:27.868306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:27.868679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:27.869529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] PATH_INFO: `/v3/projects/141b161755f94b12ac129e1ba2a328ac/users/36b30251def040939490b96f3a94e2b3/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:27.874019 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141b161755f94b12ac129e1ba2a328ac, user_id=36b30251def040939490b96f3a94e2b3, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:27.881714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:27.916690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 920/1829] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:27 2022] PUT /identity/v3/projects/141b161755f94b12ac129e1ba2a328ac/users/36b30251def040939490b96f3a94e2b3/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:27.933877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c37651-d753-4fca-8f17-4ad159828772 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:27.934079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c37651-d753-4fca-8f17-4ad159828772 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:27.934379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c37651-d753-4fca-8f17-4ad159828772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:27.994559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f9c37651-d753-4fca-8f17-4ad159828772 None None] MFA Rules not processed for user `36b30251def040939490b96f3a94e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:27.995827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f9c37651-d753-4fca-8f17-4ad159828772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:28.149797 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 910/1830] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:28.161345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:28.163142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:28.385045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f6522-4782-4d61-8731-11581579bf72 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:28.400788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39a42-8faa-412a-871c-8304d675ef12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:28.403852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39a42-8faa-412a-871c-8304d675ef12 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:28.404176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39a42-8faa-412a-871c-8304d675ef12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:28.404686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39a42-8faa-412a-871c-8304d675ef12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:28.420809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff39a42-8faa-412a-871c-8304d675ef12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:28.422899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff39a42-8faa-412a-871c-8304d675ef12 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:28.437379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 921/1831] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:28.499108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c37651-d753-4fca-8f17-4ad159828772 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:28.568170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:28.639337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c37651-d753-4fca-8f17-4ad159828772 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:28.652297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:28.652924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:28.653200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:28.653478 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] PATH_INFO: `/v3/users/8e02fd2f432b48c6991b2b46707b96a1` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:28.663731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e02fd2f432b48c6991b2b46707b96a1)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:28.665892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:28.765061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e02fd2f432b48c6991b2b46707b96a1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:28.778340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e02fd2f432b48c6991b2b46707b96a1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:28.778340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e02fd2f432b48c6991b2b46707b96a1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:28.778728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e02fd2f432b48c6991b2b46707b96a1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:28.791297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e02fd2f432b48c6991b2b46707b96a1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:28.861541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 911/1832] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:28 2022] DELETE /identity/v3/users/8e02fd2f432b48c6991b2b46707b96a1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:28.868536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ef7d2-62a6-44c3-bda9-7cfc5eeff3e6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:28.868824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ef7d2-62a6-44c3-bda9-7cfc5eeff3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:28.869097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ef7d2-62a6-44c3-bda9-7cfc5eeff3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:28.901629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a48ef7d2-62a6-44c3-bda9-7cfc5eeff3e6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:28.902904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a48ef7d2-62a6-44c3-bda9-7cfc5eeff3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:29.002383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:29.058254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:29.059996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:29.080204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 922/1833] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:29.101443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58691f5-a6d0-49da-bb29-4a5cc9077541 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:29.110091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:29.112173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:29.112894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:29.114315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] PATH_INFO: `/v3/projects/a707d978f32d436393cd9fa880e9d69c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:29.117326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a707d978f32d436393cd9fa880e9d69c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:29.128701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:29.236497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ef7d2-62a6-44c3-bda9-7cfc5eeff3e6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:29.238361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a48ef7d2-62a6-44c3-bda9-7cfc5eeff3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:29.302456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a707d978f32d436393cd9fa880e9d69c', 'request_id': 'req-1c78422a-452c-4238-8b00-d8ac723d4e9a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.313558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a707d978f32d436393cd9fa880e9d69c', 'request_id': 'req-1c78422a-452c-4238-8b00-d8ac723d4e9a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.341447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a707d978f32d436393cd9fa880e9d69c', 'request_id': 'req-1c78422a-452c-4238-8b00-d8ac723d4e9a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.387227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] The token cache is being invalidate because project a707d978f32d436393cd9fa880e9d69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:29.387612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.392736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.402844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 912/1834] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:29 2022] DELETE /identity/v3/projects/a707d978f32d436393cd9fa880e9d69c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:29.407284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:29.412264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:29.418079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ef7d2-62a6-44c3-bda9-7cfc5eeff3e6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:29.516634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:29.598716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78422a-452c-4238-8b00-d8ac723d4e9a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:29.599870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ea44b-505f-40c0-9547-174f503f8d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:29.603166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ea44b-505f-40c0-9547-174f503f8d72 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:29.603503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ea44b-505f-40c0-9547-174f503f8d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:29.605106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ea44b-505f-40c0-9547-174f503f8d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:29.610065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f05ea44b-505f-40c0-9547-174f503f8d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:29.614206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:29.616920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:29.617203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:29.617531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] PATH_INFO: `/v3/projects/5cdd15c7eb424e138654aa1597a3da46` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:29.620780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdd15c7eb424e138654aa1597a3da46)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:29.622716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:29.646140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ea44b-505f-40c0-9547-174f503f8d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:29.648340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ea44b-505f-40c0-9547-174f503f8d72 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:29.675009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 923/1835] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:29.677101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17e79b-85a1-4d32-884b-fb9e98e5ee00 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:29.677638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17e79b-85a1-4d32-884b-fb9e98e5ee00 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:29.678375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17e79b-85a1-4d32-884b-fb9e98e5ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:29.719950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0f17e79b-85a1-4d32-884b-fb9e98e5ee00 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:29.721172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f17e79b-85a1-4d32-884b-fb9e98e5ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:29.745189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdd15c7eb424e138654aa1597a3da46', 'request_id': 'req-0054bafc-c518-4b08-ae03-e3517ad40354'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.752740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdd15c7eb424e138654aa1597a3da46', 'request_id': 'req-0054bafc-c518-4b08-ae03-e3517ad40354'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.769595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdd15c7eb424e138654aa1597a3da46', 'request_id': 'req-0054bafc-c518-4b08-ae03-e3517ad40354'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.793095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] The token cache is being invalidate because project 5cdd15c7eb424e138654aa1597a3da46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:29.794449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.795495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:29.798398 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 913/1836] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:29 2022] DELETE /identity/v3/projects/5cdd15c7eb424e138654aa1597a3da46 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:29.804159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:29.807383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:29.896632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 924/1837] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:29.905777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f929-b3e4-4c54-b8a2-5e3ab6dd4bcc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:29.906205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f929-b3e4-4c54-b8a2-5e3ab6dd4bcc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:29.906455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f929-b3e4-4c54-b8a2-5e3ab6dd4bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:29.940393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054bafc-c518-4b08-ae03-e3517ad40354 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:29.948595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b014f929-b3e4-4c54-b8a2-5e3ab6dd4bcc None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:29.951156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b014f929-b3e4-4c54-b8a2-5e3ab6dd4bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:29.966336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 925/1838] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:29.968916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014f929-b3e4-4c54-b8a2-5e3ab6dd4bcc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:29.981845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014f929-b3e4-4c54-b8a2-5e3ab6dd4bcc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:29.988796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:29.989471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:29.989785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:29.990061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:29.990718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:29.991062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:29.993978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:29.994586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:29.998108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:29.999396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.000097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] PATH_INFO: `/v3/users/b349f081c5aa43ae86e225df5aa0a965` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.005118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b349f081c5aa43ae86e225df5aa0a965)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.013448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 926/1839] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:30.018394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.020479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:30.034391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424d713-8109-46ed-86fc-b3d2299e31ce admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:30.041309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a9c55-a1b1-45de-8250-b55a68115f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:30.041932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a9c55-a1b1-45de-8250-b55a68115f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.042206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a9c55-a1b1-45de-8250-b55a68115f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.042911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a9c55-a1b1-45de-8250-b55a68115f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.043561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a9c55-a1b1-45de-8250-b55a68115f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.046102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a9c55-a1b1-45de-8250-b55a68115f6f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.104672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 927/1840] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:30 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:30.108474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a9c55-a1b1-45de-8250-b55a68115f6f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:30.116667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b349f081c5aa43ae86e225df5aa0a965'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:30.117049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:30.129428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b349f081c5aa43ae86e225df5aa0a965'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:30.130481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b349f081c5aa43ae86e225df5aa0a965'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:30.131057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b349f081c5aa43ae86e225df5aa0a965'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:30.141469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b349f081c5aa43ae86e225df5aa0a965'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:30.143179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:30.178114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 914/1841] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:29 2022] DELETE /identity/v3/users/b349f081c5aa43ae86e225df5aa0a965 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:30.245534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a9c55-a1b1-45de-8250-b55a68115f6f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:30.330512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80014ffa-0cb1-4414-a06d-794bdf7a2dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:30.331175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014ffa-0cb1-4414-a06d-794bdf7a2dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.331454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014ffa-0cb1-4414-a06d-794bdf7a2dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.331759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014ffa-0cb1-4414-a06d-794bdf7a2dcf admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.333510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80014ffa-0cb1-4414-a06d-794bdf7a2dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.336874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80014ffa-0cb1-4414-a06d-794bdf7a2dcf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.385245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 928/1842] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:30 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:30.390243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:30.392448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:30.408259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6deb0-bde8-430a-bcd3-08b1fc0d6f23 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:30.413457 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336f67-490a-4ef2-bd84-36ee018b5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:30.414309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336f67-490a-4ef2-bd84-36ee018b5614 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.415473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336f67-490a-4ef2-bd84-36ee018b5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.415757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336f67-490a-4ef2-bd84-36ee018b5614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.416559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e336f67-490a-4ef2-bd84-36ee018b5614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.418164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e336f67-490a-4ef2-bd84-36ee018b5614 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.428703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 915/1843] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:30.433177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80014ffa-0cb1-4414-a06d-794bdf7a2dcf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:30.443558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80014ffa-0cb1-4414-a06d-794bdf7a2dcf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:30.449279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aecc33-2a89-49fe-b3c1-859ca2833999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:30.450049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aecc33-2a89-49fe-b3c1-859ca2833999 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.450420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aecc33-2a89-49fe-b3c1-859ca2833999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.450846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aecc33-2a89-49fe-b3c1-859ca2833999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.451585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aecc33-2a89-49fe-b3c1-859ca2833999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.453320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aecc33-2a89-49fe-b3c1-859ca2833999 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.466974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 929/1844] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:30.471142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336f67-490a-4ef2-bd84-36ee018b5614 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:30.484951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336f67-490a-4ef2-bd84-36ee018b5614 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:30.489402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:30.490142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.490607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.490925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] PATH_INFO: `/v3/projects/ebedd490232d489694130fd7684a5d08/users/2d4207d0a1f34fd389521cbf98322953/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.506599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebedd490232d489694130fd7684a5d08, user_id=2d4207d0a1f34fd389521cbf98322953, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.509705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.527477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 916/1845] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:30 2022] PUT /identity/v3/projects/ebedd490232d489694130fd7684a5d08/users/2d4207d0a1f34fd389521cbf98322953/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:30.538638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5497e0-8000-42dd-82f2-4ad9be515cce None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.538959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5497e0-8000-42dd-82f2-4ad9be515cce None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.539238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5497e0-8000-42dd-82f2-4ad9be515cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.582090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5e5497e0-8000-42dd-82f2-4ad9be515cce None None] MFA Rules not processed for user `2d4207d0a1f34fd389521cbf98322953`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:30.583342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e5497e0-8000-42dd-82f2-4ad9be515cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:30.686529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 930/1846] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:30.698472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:30.700903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:30.754731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5497e0-8000-42dd-82f2-4ad9be515cce None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:30.756451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e5497e0-8000-42dd-82f2-4ad9be515cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:30.789078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:30.820278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b052cd-48d2-4947-80ce-668b74572fbb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:30.828938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:30.830404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.830859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.831691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.844524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.846304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.863693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 917/1847] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:30.865499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:30.868698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:30.898127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b63842-1669-4d98-bf5e-74beb534c226 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:30.911201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5497e0-8000-42dd-82f2-4ad9be515cce None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:30.916559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:30.917787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.918129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.918513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] PATH_INFO: `/v3/projects/65956194bdad4f949e296b58ec868bae` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.919929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65956194bdad4f949e296b58ec868bae)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.921745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:30.922675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:30.922897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:30.923304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] PATH_INFO: `/v3/projects/ce689986bb60486db27b5a8faa2d71aa` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:30.924410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce689986bb60486db27b5a8faa2d71aa)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:30.926319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.934064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:30.996172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce689986bb60486db27b5a8faa2d71aa', 'request_id': 'req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.004115 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce689986bb60486db27b5a8faa2d71aa', 'request_id': 'req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.008863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65956194bdad4f949e296b58ec868bae', 'request_id': 'req-ddfa906e-51f8-4100-af73-66d37240451d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.012129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce689986bb60486db27b5a8faa2d71aa', 'request_id': 'req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.016434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65956194bdad4f949e296b58ec868bae', 'request_id': 'req-ddfa906e-51f8-4100-af73-66d37240451d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.024848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65956194bdad4f949e296b58ec868bae', 'request_id': 'req-ddfa906e-51f8-4100-af73-66d37240451d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.027471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] The token cache is being invalidate because project ce689986bb60486db27b5a8faa2d71aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:31.027759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.028561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.032899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 931/1848] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:30 2022] DELETE /identity/v3/projects/ce689986bb60486db27b5a8faa2d71aa => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:31.032899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.032899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.042063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] The token cache is being invalidate because project 65956194bdad4f949e296b58ec868bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:31.042464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.043185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.045590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 918/1849] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:30 2022] DELETE /identity/v3/projects/65956194bdad4f949e296b58ec868bae => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:31.046011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.049364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.092562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:31.112771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2fbf7-eb6e-4046-94c7-8a4b57f8d899 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:31.158154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa906e-51f8-4100-af73-66d37240451d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:31.165089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:31.165792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.166069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.166338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] PATH_INFO: `/v3/users/36b30251def040939490b96f3a94e2b3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.167596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b30251def040939490b96f3a94e2b3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:31.169626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:31.201102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:31.212999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:31.214774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.215223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.215504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] PATH_INFO: `/v3/users/2d4207d0a1f34fd389521cbf98322953` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.217995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4207d0a1f34fd389521cbf98322953)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:31.220446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:31.231155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b30251def040939490b96f3a94e2b3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.245481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b30251def040939490b96f3a94e2b3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.246245 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b30251def040939490b96f3a94e2b3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.247069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b30251def040939490b96f3a94e2b3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.259105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5f4e659a-c143-4549-b730-367855fd29be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b30251def040939490b96f3a94e2b3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.285937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4207d0a1f34fd389521cbf98322953'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.287007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 919/1850] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:31 2022] DELETE /identity/v3/users/36b30251def040939490b96f3a94e2b3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:31.288206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28e44b-2619-4a86-918f-2dca290dbd6f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.288494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28e44b-2619-4a86-918f-2dca290dbd6f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.292443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28e44b-2619-4a86-918f-2dca290dbd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.296307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4207d0a1f34fd389521cbf98322953'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.297234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4207d0a1f34fd389521cbf98322953'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.298410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4207d0a1f34fd389521cbf98322953'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.308262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4207d0a1f34fd389521cbf98322953'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.330048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6b28e44b-2619-4a86-918f-2dca290dbd6f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:31.332173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6b28e44b-2619-4a86-918f-2dca290dbd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.332333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 932/1851] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:31 2022] DELETE /identity/v3/users/2d4207d0a1f34fd389521cbf98322953 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:31.333278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.334698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.438688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 920/1852] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:31.440290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8f2b-a9e5-43a3-97e3-b09184dc8a21 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.440576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8f2b-a9e5-43a3-97e3-b09184dc8a21 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.440852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8f2b-a9e5-43a3-97e3-b09184dc8a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.490554 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-978a8f2b-a9e5-43a3-97e3-b09184dc8a21 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:31.491464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95512ca2-6cdb-4023-b586-95f28fcb8c7d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:31.494782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-978a8f2b-a9e5-43a3-97e3-b09184dc8a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.504549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:31.505427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.505880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.506357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] PATH_INFO: `/v3/users/61cccaa9f7c041249a80bb27efe950d5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.509769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cccaa9f7c041249a80bb27efe950d5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:31.512563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:31.514255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 921/1853] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:31.515773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df783f6-f4b2-44af-9148-6d00d11ede5d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.516205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df783f6-f4b2-44af-9148-6d00d11ede5d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.516500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df783f6-f4b2-44af-9148-6d00d11ede5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.539882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9df783f6-f4b2-44af-9148-6d00d11ede5d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:31.541311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9df783f6-f4b2-44af-9148-6d00d11ede5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.572099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 922/1854] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:31.573475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df783f6-f4b2-44af-9148-6d00d11ede5d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.575539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9df783f6-f4b2-44af-9148-6d00d11ede5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.594892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cccaa9f7c041249a80bb27efe950d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.606361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cccaa9f7c041249a80bb27efe950d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.607084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cccaa9f7c041249a80bb27efe950d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.607757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cccaa9f7c041249a80bb27efe950d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.616795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cccaa9f7c041249a80bb27efe950d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.631689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:31.640875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 933/1855] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:31 2022] DELETE /identity/v3/users/61cccaa9f7c041249a80bb27efe950d5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:31.642410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.647337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.672350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:31.691081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df783f6-f4b2-44af-9148-6d00d11ede5d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:31.739913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479326-8888-4098-a7f8-4bbd68b7e034 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:31.745885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:31.746276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b511-940a-48df-8a9c-b290b6bd77e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:31.746701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.747016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.747135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b511-940a-48df-8a9c-b290b6bd77e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.747342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.747461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b511-940a-48df-8a9c-b290b6bd77e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.747538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b511-940a-48df-8a9c-b290b6bd77e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.748415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b511-940a-48df-8a9c-b290b6bd77e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:31.748783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b511-940a-48df-8a9c-b290b6bd77e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:31.749432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.750490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b511-940a-48df-8a9c-b290b6bd77e8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:31.764871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:31.766315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:31.766873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 934/1856] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:31.768038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062c390-8b5a-4d1e-9478-de1b6d32f159 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.768382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062c390-8b5a-4d1e-9478-de1b6d32f159 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.768743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062c390-8b5a-4d1e-9478-de1b6d32f159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.785827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 923/1857] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:31.787140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.788748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.788863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3062c390-8b5a-4d1e-9478-de1b6d32f159 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:31.790349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3062c390-8b5a-4d1e-9478-de1b6d32f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.799372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 935/1858] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:31.800386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062c390-8b5a-4d1e-9478-de1b6d32f159 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.803789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ac65-ad9c-4858-beb6-eca0da847860 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:31.809860 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:31.810537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.810809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.811088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] PATH_INFO: `/v3/projects/141b161755f94b12ac129e1ba2a328ac` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.812225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] RBAC: Authorizing `identity:delete_project(project_id=141b161755f94b12ac129e1ba2a328ac)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:31.814174 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:31.816644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062c390-8b5a-4d1e-9478-de1b6d32f159 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:31.823357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:31.823689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:31.823966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:31.824233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:31.824998 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:31.826905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:31.873056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 936/1859] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:31 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:31.877058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.882770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:31.884410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141b161755f94b12ac129e1ba2a328ac', 'request_id': 'req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.893402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141b161755f94b12ac129e1ba2a328ac', 'request_id': 'req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.903903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141b161755f94b12ac129e1ba2a328ac', 'request_id': 'req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.926071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] The token cache is being invalidate because project 141b161755f94b12ac129e1ba2a328ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:31.926481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.927525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:31.929264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 924/1860] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:31 2022] DELETE /identity/v3/projects/141b161755f94b12ac129e1ba2a328ac => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:31.930924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:31.933032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:32.000182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b417-4758-47fb-bbbf-2abbbb5dfdca admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.007778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.008519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.008985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.009103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.012982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:32.033622 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2781d4f-a6a3-4397-ba6f-8a1a8f29172d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.080339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:32.123035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe5d49-10cd-498a-8b38-df511f30c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.123652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe5d49-10cd-498a-8b38-df511f30c9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.123928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe5d49-10cd-498a-8b38-df511f30c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.124197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe5d49-10cd-498a-8b38-df511f30c9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.124941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe5d49-10cd-498a-8b38-df511f30c9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.126724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe5d49-10cd-498a-8b38-df511f30c9d6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.133392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.135482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.154596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 925/1861] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:31 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:32.156071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e598d6-08a0-46c8-aa8a-9d7d24f4d5fe None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.156356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e598d6-08a0-46c8-aa8a-9d7d24f4d5fe None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.156626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e598d6-08a0-46c8-aa8a-9d7d24f4d5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.157948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 937/1862] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:32.158717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.170105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada059e-a7f2-4d48-a769-f5e799dda0ab service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.175468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8b97-ec72-4b06-ab4e-31f674922424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.176586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8b97-ec72-4b06-ab4e-31f674922424 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.176873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8b97-ec72-4b06-ab4e-31f674922424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.177049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-24e598d6-08a0-46c8-aa8a-9d7d24f4d5fe None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:32.177179 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8b97-ec72-4b06-ab4e-31f674922424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.177777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8b97-ec72-4b06-ab4e-31f674922424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.178222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-24e598d6-08a0-46c8-aa8a-9d7d24f4d5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:32.179395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8b97-ec72-4b06-ab4e-31f674922424 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.184914 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:32.187067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 926/1863] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:32.193871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 938/1864] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:32.195009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8b97-ec72-4b06-ab4e-31f674922424 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.195133 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244061-55a0-401b-bf1e-993a20dd98ee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.195295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244061-55a0-401b-bf1e-993a20dd98ee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.196154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244061-55a0-401b-bf1e-993a20dd98ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.207338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8b97-ec72-4b06-ab4e-31f674922424 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.213908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274cd36-d007-4836-9939-967c3dd73f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.214789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274cd36-d007-4836-9939-967c3dd73f0f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.215271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274cd36-d007-4836-9939-967c3dd73f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.215729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274cd36-d007-4836-9939-967c3dd73f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.216528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274cd36-d007-4836-9939-967c3dd73f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.218131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-28244061-55a0-401b-bf1e-993a20dd98ee None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:32.218713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274cd36-d007-4836-9939-967c3dd73f0f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.219363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-28244061-55a0-401b-bf1e-993a20dd98ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:32.228299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 927/1865] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:32.230434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 939/1866] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:32.234812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274cd36-d007-4836-9939-967c3dd73f0f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.234949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28244061-55a0-401b-bf1e-993a20dd98ee None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.246299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28244061-55a0-401b-bf1e-993a20dd98ee None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.246466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274cd36-d007-4836-9939-967c3dd73f0f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.251136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fa159-145d-49f2-b110-0ff7b5eb1987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.251781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa159-145d-49f2-b110-0ff7b5eb1987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.252105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.252243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa159-145d-49f2-b110-0ff7b5eb1987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.252476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa159-145d-49f2-b110-0ff7b5eb1987 admin admin] PATH_INFO: `/v3/projects/3cf6235da0e74d879e0581dab126f7d3/users/f6f398722ba1498eb188d647c929d844/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.253309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.253748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.254197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.255063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:32.255600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.257633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.269246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fa159-145d-49f2-b110-0ff7b5eb1987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf6235da0e74d879e0581dab126f7d3, user_id=f6f398722ba1498eb188d647c929d844, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.272001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fa159-145d-49f2-b110-0ff7b5eb1987 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.273398 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 928/1867] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:01:32.278145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.290241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e3dc2-9f8f-4f29-a476-56fa2a77fff6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.298317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 940/1868] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:32 2022] PUT /identity/v3/projects/3cf6235da0e74d879e0581dab126f7d3/users/f6f398722ba1498eb188d647c929d844/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:32.300753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8792ed-a381-454e-bb1f-68c6dda9accd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.301500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8792ed-a381-454e-bb1f-68c6dda9accd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.301788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8792ed-a381-454e-bb1f-68c6dda9accd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.340296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9a8792ed-a381-454e-bb1f-68c6dda9accd None None] MFA Rules not processed for user `f6f398722ba1498eb188d647c929d844`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:32.341528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9a8792ed-a381-454e-bb1f-68c6dda9accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:32.357139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f220-eeaf-4396-9e5a-b2dc2b9e4145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.357738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f220-eeaf-4396-9e5a-b2dc2b9e4145 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.358009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f220-eeaf-4396-9e5a-b2dc2b9e4145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.358273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f220-eeaf-4396-9e5a-b2dc2b9e4145 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.358934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0f220-eeaf-4396-9e5a-b2dc2b9e4145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.360830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0f220-eeaf-4396-9e5a-b2dc2b9e4145 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.396765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 929/1869] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:32 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:32.397843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f220-eeaf-4396-9e5a-b2dc2b9e4145 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.420090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 941/1870] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:32.424291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8792ed-a381-454e-bb1f-68c6dda9accd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.436068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8792ed-a381-454e-bb1f-68c6dda9accd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.487337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f220-eeaf-4396-9e5a-b2dc2b9e4145 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.499058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40bb24-80b8-412f-881b-1a94b1340042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.499959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40bb24-80b8-412f-881b-1a94b1340042 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.500238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40bb24-80b8-412f-881b-1a94b1340042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.500509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40bb24-80b8-412f-881b-1a94b1340042 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.501175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40bb24-80b8-412f-881b-1a94b1340042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.503157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40bb24-80b8-412f-881b-1a94b1340042 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.509994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa775d66-b69c-4807-ba5c-c2ab9e194388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.510810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa775d66-b69c-4807-ba5c-c2ab9e194388 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.511190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa775d66-b69c-4807-ba5c-c2ab9e194388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.511555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa775d66-b69c-4807-ba5c-c2ab9e194388 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.512427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa775d66-b69c-4807-ba5c-c2ab9e194388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.514873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa775d66-b69c-4807-ba5c-c2ab9e194388 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.533663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 930/1871] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:32 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:32.537352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40bb24-80b8-412f-881b-1a94b1340042 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.545383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:32.549783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40bb24-80b8-412f-881b-1a94b1340042 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.559006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 942/1872] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:32 2022] POST /identity/v3/projects => generated 389 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:32.560136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa775d66-b69c-4807-ba5c-c2ab9e194388 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.566412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82405350-3e3f-4ad7-b930-92272bbca396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.567944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82405350-3e3f-4ad7-b930-92272bbca396 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.568429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82405350-3e3f-4ad7-b930-92272bbca396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.568710 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82405350-3e3f-4ad7-b930-92272bbca396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.569781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82405350-3e3f-4ad7-b930-92272bbca396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.571974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82405350-3e3f-4ad7-b930-92272bbca396 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.590237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 931/1873] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:01:32.593021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82405350-3e3f-4ad7-b930-92272bbca396 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.605199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82405350-3e3f-4ad7-b930-92272bbca396 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.675915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:32.701502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6151f72-f2b9-4eeb-b452-39fcaf5dd309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.702572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6151f72-f2b9-4eeb-b452-39fcaf5dd309 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.702969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6151f72-f2b9-4eeb-b452-39fcaf5dd309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.703312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6151f72-f2b9-4eeb-b452-39fcaf5dd309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.704375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6151f72-f2b9-4eeb-b452-39fcaf5dd309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.707099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6151f72-f2b9-4eeb-b452-39fcaf5dd309 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.733246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 932/1874] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:32.735281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6151f72-f2b9-4eeb-b452-39fcaf5dd309 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.740423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa775d66-b69c-4807-ba5c-c2ab9e194388 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.756222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1dfc-9101-49ba-a589-47c88d6bd6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.759895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1dfc-9101-49ba-a589-47c88d6bd6cc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.761339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6151f72-f2b9-4eeb-b452-39fcaf5dd309 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.761751 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1dfc-9101-49ba-a589-47c88d6bd6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.762131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1dfc-9101-49ba-a589-47c88d6bd6cc admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.767509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1dfc-9101-49ba-a589-47c88d6bd6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.772220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1dfc-9101-49ba-a589-47c88d6bd6cc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.780449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805db8d7-8d55-430b-942b-ea010eba25d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:32.781143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805db8d7-8d55-430b-942b-ea010eba25d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.782037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805db8d7-8d55-430b-942b-ea010eba25d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.782243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805db8d7-8d55-430b-942b-ea010eba25d4 admin admin] PATH_INFO: `/v3/projects/93482262b7414435be1fe7079f2c68c5/users/6101e0b800d540b296c5c5c59f507b29/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.808438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805db8d7-8d55-430b-942b-ea010eba25d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93482262b7414435be1fe7079f2c68c5, user_id=6101e0b800d540b296c5c5c59f507b29, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:32.820099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805db8d7-8d55-430b-942b-ea010eba25d4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:32.846812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 943/1875] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:32 2022] POST /identity/v3/users => generated 301 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:32.848373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1dfc-9101-49ba-a589-47c88d6bd6cc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:32.855691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 933/1876] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:32 2022] PUT /identity/v3/projects/93482262b7414435be1fe7079f2c68c5/users/6101e0b800d540b296c5c5c59f507b29/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:32.857315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff946d7-5055-4a73-abc2-a5caf48ac121 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:32.857669 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff946d7-5055-4a73-abc2-a5caf48ac121 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:32.858528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff946d7-5055-4a73-abc2-a5caf48ac121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:32.881962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1dfc-9101-49ba-a589-47c88d6bd6cc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:32.901363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bff946d7-5055-4a73-abc2-a5caf48ac121 None None] MFA Rules not processed for user `6101e0b800d540b296c5c5c59f507b29`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:32.902667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bff946d7-5055-4a73-abc2-a5caf48ac121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.045078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db750001-afa4-4810-a405-3260470fa145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.045986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db750001-afa4-4810-a405-3260470fa145 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.047004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db750001-afa4-4810-a405-3260470fa145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.047355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db750001-afa4-4810-a405-3260470fa145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.053525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 934/1877] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:33.056633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db750001-afa4-4810-a405-3260470fa145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.058776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff946d7-5055-4a73-abc2-a5caf48ac121 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.061875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db750001-afa4-4810-a405-3260470fa145 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.084830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 944/1878] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:01:33.085161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff946d7-5055-4a73-abc2-a5caf48ac121 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.087295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db750001-afa4-4810-a405-3260470fa145 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.092098 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64f03-6384-4d50-8cf7-3bfdf7811866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.093085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64f03-6384-4d50-8cf7-3bfdf7811866 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.093588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64f03-6384-4d50-8cf7-3bfdf7811866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.094096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64f03-6384-4d50-8cf7-3bfdf7811866 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.095121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d64f03-6384-4d50-8cf7-3bfdf7811866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.098062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d64f03-6384-4d50-8cf7-3bfdf7811866 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.105559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db750001-afa4-4810-a405-3260470fa145 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.111318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424a7eb-1c28-4926-9747-85b88fa5b4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.112039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424a7eb-1c28-4926-9747-85b88fa5b4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.112320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424a7eb-1c28-4926-9747-85b88fa5b4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.112595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424a7eb-1c28-4926-9747-85b88fa5b4f6 admin admin] PATH_INFO: `/v3/projects/7fbb4b1825774b00a544b39d1c2811b0/users/27eb500aa43b47cb94330a8d318a86a9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.132835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424a7eb-1c28-4926-9747-85b88fa5b4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbb4b1825774b00a544b39d1c2811b0, user_id=27eb500aa43b47cb94330a8d318a86a9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.136675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424a7eb-1c28-4926-9747-85b88fa5b4f6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.160917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 935/1879] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:33 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:33.163686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64f03-6384-4d50-8cf7-3bfdf7811866 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.175290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 945/1880] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:33 2022] PUT /identity/v3/projects/7fbb4b1825774b00a544b39d1c2811b0/users/27eb500aa43b47cb94330a8d318a86a9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:33.179672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424a7eb-1c28-4926-9747-85b88fa5b4f6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.251508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:33.323508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64f03-6384-4d50-8cf7-3bfdf7811866 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.324496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424a7eb-1c28-4926-9747-85b88fa5b4f6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.329401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.330410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.330929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.331272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.331854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee0820-dfba-4f71-adb8-f22a8a553622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.332205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.332468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0820-dfba-4f71-adb8-f22a8a553622 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.332754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0820-dfba-4f71-adb8-f22a8a553622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.333029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0820-dfba-4f71-adb8-f22a8a553622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.333679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee0820-dfba-4f71-adb8-f22a8a553622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.334467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.336105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee0820-dfba-4f71-adb8-f22a8a553622 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.373217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 936/1881] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:33 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:33.374601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.376900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.382090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 946/1882] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:33.386515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee0820-dfba-4f71-adb8-f22a8a553622 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.400945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438275-9951-4b73-85cf-8387a0b34e71 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.403929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee0820-dfba-4f71-adb8-f22a8a553622 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.410475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5034b49-b8a1-4058-8b6e-385dcd50c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.411206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.411650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034b49-b8a1-4058-8b6e-385dcd50c949 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.411861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.412146 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.412423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] PATH_INFO: `/v3/projects/ebedd490232d489694130fd7684a5d08` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.412801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034b49-b8a1-4058-8b6e-385dcd50c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.413343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034b49-b8a1-4058-8b6e-385dcd50c949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.413888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebedd490232d489694130fd7684a5d08)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.414387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5034b49-b8a1-4058-8b6e-385dcd50c949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.416774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.417080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5034b49-b8a1-4058-8b6e-385dcd50c949 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.433261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 947/1883] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:33.434635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5034b49-b8a1-4058-8b6e-385dcd50c949 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.451739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5034b49-b8a1-4058-8b6e-385dcd50c949 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.459446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd928a3-a229-4e71-8e0b-dccb0e291979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.460159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd928a3-a229-4e71-8e0b-dccb0e291979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.460434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd928a3-a229-4e71-8e0b-dccb0e291979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.460809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd928a3-a229-4e71-8e0b-dccb0e291979 admin admin] PATH_INFO: `/v3/projects/7fbb4b1825774b00a544b39d1c2811b0/users/27eb500aa43b47cb94330a8d318a86a9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.481823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd928a3-a229-4e71-8e0b-dccb0e291979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbb4b1825774b00a544b39d1c2811b0, user_id=27eb500aa43b47cb94330a8d318a86a9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.481823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd928a3-a229-4e71-8e0b-dccb0e291979 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.508684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 948/1884] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:33 2022] PUT /identity/v3/projects/7fbb4b1825774b00a544b39d1c2811b0/users/27eb500aa43b47cb94330a8d318a86a9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:33.509803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd928a3-a229-4e71-8e0b-dccb0e291979 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.517779 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebedd490232d489694130fd7684a5d08', 'request_id': 'req-5592ce8d-ca04-48b6-852a-aa756e9bad57'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.525337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebedd490232d489694130fd7684a5d08', 'request_id': 'req-5592ce8d-ca04-48b6-852a-aa756e9bad57'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.526889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:33.536717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebedd490232d489694130fd7684a5d08', 'request_id': 'req-5592ce8d-ca04-48b6-852a-aa756e9bad57'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.552828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] The token cache is being invalidate because project ebedd490232d489694130fd7684a5d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:33.552828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.553459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5592ce8d-ca04-48b6-852a-aa756e9bad57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.556709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 937/1885] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:33 2022] DELETE /identity/v3/projects/ebedd490232d489694130fd7684a5d08 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:33.558017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe890b2-a84d-4460-bdca-9344a9f69c18 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.558304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe890b2-a84d-4460-bdca-9344a9f69c18 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.558574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe890b2-a84d-4460-bdca-9344a9f69c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.589677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bbe890b2-a84d-4460-bdca-9344a9f69c18 None None] MFA Rules not processed for user `27eb500aa43b47cb94330a8d318a86a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:33.591007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bbe890b2-a84d-4460-bdca-9344a9f69c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.594073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd928a3-a229-4e71-8e0b-dccb0e291979 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.676246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.676975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.677255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.677524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] PATH_INFO: `/v3/projects/19187c64954c4d79aa2b276b0c173fa7/users/2dc579d4ee7940d98f1efcfb3767f221/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.690010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 938/1886] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:33.691339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabf02-9e0a-4b98-9f0e-37b2d1f9aa17 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.691565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabf02-9e0a-4b98-9f0e-37b2d1f9aa17 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.691850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabf02-9e0a-4b98-9f0e-37b2d1f9aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.698337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19187c64954c4d79aa2b276b0c173fa7, user_id=2dc579d4ee7940d98f1efcfb3767f221, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.701373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.713977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-40fabf02-9e0a-4b98-9f0e-37b2d1f9aa17 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:33.715243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-40fabf02-9e0a-4b98-9f0e-37b2d1f9aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.719485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 949/1887] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:33 2022] PUT /identity/v3/projects/19187c64954c4d79aa2b276b0c173fa7/users/2dc579d4ee7940d98f1efcfb3767f221/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:33.720783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.723079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.749782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:33.800528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 939/1888] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:33.800528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabf02-9e0a-4b98-9f0e-37b2d1f9aa17 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.800528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-40fabf02-9e0a-4b98-9f0e-37b2d1f9aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.802085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1124b-1f8a-4c7d-b965-5fb2a8cefe3e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.807887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289dab3-25a6-4d99-a5d1-9e4917b7d8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.808748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289dab3-25a6-4d99-a5d1-9e4917b7d8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.809105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289dab3-25a6-4d99-a5d1-9e4917b7d8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.809441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289dab3-25a6-4d99-a5d1-9e4917b7d8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.811015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabf02-9e0a-4b98-9f0e-37b2d1f9aa17 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.815554 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.816276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.816551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.816814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.817448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.819051 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.829932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 940/1889] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:33.830793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.832591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.846830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8336e8-6906-4918-8fba-c6e866d2a121 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:33.851232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:33.852402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.852827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.853328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] PATH_INFO: `/v3/projects/b95598c9fcce44ad95580a00c7b31fe3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.854440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95598c9fcce44ad95580a00c7b31fe3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.856381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.870009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:33.873628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289dab3-25a6-4d99-a5d1-9e4917b7d8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:33.875548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289dab3-25a6-4d99-a5d1-9e4917b7d8f5 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:33.887713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 950/1890] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:33.888828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54d2a-da7b-4a7c-9539-f7af8ef597da None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:33.889214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54d2a-da7b-4a7c-9539-f7af8ef597da None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:33.889517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54d2a-da7b-4a7c-9539-f7af8ef597da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:33.905587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95598c9fcce44ad95580a00c7b31fe3', 'request_id': 'req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.911359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95598c9fcce44ad95580a00c7b31fe3', 'request_id': 'req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.917674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-05f54d2a-da7b-4a7c-9539-f7af8ef597da None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:33.919161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-05f54d2a-da7b-4a7c-9539-f7af8ef597da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.920650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95598c9fcce44ad95580a00c7b31fe3', 'request_id': 'req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.934979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] The token cache is being invalidate because project b95598c9fcce44ad95580a00c7b31fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:33.935321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.936030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:33.937717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 941/1891] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:33 2022] DELETE /identity/v3/projects/b95598c9fcce44ad95580a00c7b31fe3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:33.938456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.939802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:33.996851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 951/1892] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:33.997982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54d2a-da7b-4a7c-9539-f7af8ef597da None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:33.999343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-05f54d2a-da7b-4a7c-9539-f7af8ef597da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.011154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe587b-3a87-4ebd-a15b-f05993c6e79f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:34.012450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54d2a-da7b-4a7c-9539-f7af8ef597da None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:34.016418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4222c-108e-4b1e-aff2-1f5401054057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:34.017074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4222c-108e-4b1e-aff2-1f5401054057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.017361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4222c-108e-4b1e-aff2-1f5401054057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.017633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4222c-108e-4b1e-aff2-1f5401054057 admin admin] PATH_INFO: `/v3/projects/19187c64954c4d79aa2b276b0c173fa7/users/2dc579d4ee7940d98f1efcfb3767f221/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.019742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4222c-108e-4b1e-aff2-1f5401054057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19187c64954c4d79aa2b276b0c173fa7, user_id=2dc579d4ee7940d98f1efcfb3767f221, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:34.022431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4222c-108e-4b1e-aff2-1f5401054057 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:34.024918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:34.026012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.026824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.027292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] PATH_INFO: `/v3/users/20694b4dc81d43b394dde2a74ff572a9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.028552 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=20694b4dc81d43b394dde2a74ff572a9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:34.031001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:34.034531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 942/1893] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:33 2022] PUT /identity/v3/projects/19187c64954c4d79aa2b276b0c173fa7/users/2dc579d4ee7940d98f1efcfb3767f221/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:34.035410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4222c-108e-4b1e-aff2-1f5401054057 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:34.091243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:34.094081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20694b4dc81d43b394dde2a74ff572a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.104335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20694b4dc81d43b394dde2a74ff572a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.105407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20694b4dc81d43b394dde2a74ff572a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.106068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20694b4dc81d43b394dde2a74ff572a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.115213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4fcc6887-eacc-4345-b037-ab14d2037e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20694b4dc81d43b394dde2a74ff572a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.118286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4222c-108e-4b1e-aff2-1f5401054057 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:34.123990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:34.124768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.125194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.125722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.126665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:34.127141 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:34.129078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:34.134817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 952/1894] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:33 2022] DELETE /identity/v3/users/20694b4dc81d43b394dde2a74ff572a9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:34.135839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb622-43fa-49dc-9fe1-234d3d5987e1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.135839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb622-43fa-49dc-9fe1-234d3d5987e1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.136037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb622-43fa-49dc-9fe1-234d3d5987e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.144778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 943/1895] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:34.145752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:34.148225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.163295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b023b5b-279d-4db6-b340-ae78ef3d950c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:34.183241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-741fb622-43fa-49dc-9fe1-234d3d5987e1 None None] MFA Rules not processed for user `2dc579d4ee7940d98f1efcfb3767f221`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:34.185117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-741fb622-43fa-49dc-9fe1-234d3d5987e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.262294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:34.263194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.263333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.263601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] PATH_INFO: `/v3/users/f6f398722ba1498eb188d647c929d844` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.265315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f398722ba1498eb188d647c929d844)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:34.267087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:34.268286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:34.295681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 953/1896] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:34.297173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fb622-43fa-49dc-9fe1-234d3d5987e1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:34.301343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-741fb622-43fa-49dc-9fe1-234d3d5987e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.326647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fb622-43fa-49dc-9fe1-234d3d5987e1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:34.333485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:34.334212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.334444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.334926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.338647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:34.338770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f398722ba1498eb188d647c929d844'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.343105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:34.399733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f398722ba1498eb188d647c929d844'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.400831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f398722ba1498eb188d647c929d844'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.402528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f398722ba1498eb188d647c929d844'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.413521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f398722ba1498eb188d647c929d844'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:34.426738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 954/1897] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:34 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:34.430976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:34.440986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.546054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 944/1898] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:34 2022] DELETE /identity/v3/users/f6f398722ba1498eb188d647c929d844 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:34.555615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:34.563463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.678854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8441-8a86-4114-969c-8a5c23056537 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:34.713880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:34.748018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90fd2f-12e4-47fe-94b1-bc01e11702cc admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:34.759366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81510cb5-37f0-459e-a78f-8cfb837bb2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:34.763103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81510cb5-37f0-459e-a78f-8cfb837bb2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.763427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81510cb5-37f0-459e-a78f-8cfb837bb2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.763764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81510cb5-37f0-459e-a78f-8cfb837bb2fb admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.764532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81510cb5-37f0-459e-a78f-8cfb837bb2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:34.768027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81510cb5-37f0-459e-a78f-8cfb837bb2fb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:34.808727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 945/1899] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:34 2022] POST /identity/v3/users => generated 281 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:34.809338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07059-4a15-486e-af19-857a66357b6e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.809738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07059-4a15-486e-af19-857a66357b6e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.810074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07059-4a15-486e-af19-857a66357b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.841076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:34.841706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.847237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.847237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.847237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.863420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-62e07059-4a15-486e-af19-857a66357b6e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:34.868209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-62e07059-4a15-486e-af19-857a66357b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.889462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 946/1900] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:34.890114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07059-4a15-486e-af19-857a66357b6e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:34.892677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-62e07059-4a15-486e-af19-857a66357b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:34.912817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07059-4a15-486e-af19-857a66357b6e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:34.918666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:34.919106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:34.919679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:34.919679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] PATH_INFO: `/v3/projects/c33bd252794e4f0e92f458cc2039ec3e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:34.923424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33bd252794e4f0e92f458cc2039ec3e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:34.926704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:34.969483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:34.973107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.014894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 955/1901] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:35.016318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.026578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33bd252794e4f0e92f458cc2039ec3e', 'request_id': 'req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.033149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33bd252794e4f0e92f458cc2039ec3e', 'request_id': 'req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.034411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c3a1-562c-4fa6-906f-6353e2abc521 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.048095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33bd252794e4f0e92f458cc2039ec3e', 'request_id': 'req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.063574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] The token cache is being invalidate because project c33bd252794e4f0e92f458cc2039ec3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:35.063877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.064862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.069780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 947/1902] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:34 2022] DELETE /identity/v3/projects/c33bd252794e4f0e92f458cc2039ec3e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:35.069780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.072471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.112310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:35.143281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c0341-aa2d-4db4-956e-96934e511846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.144476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c0341-aa2d-4db4-956e-96934e511846 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.144476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c0341-aa2d-4db4-956e-96934e511846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.144660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c0341-aa2d-4db4-956e-96934e511846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.145252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c0341-aa2d-4db4-956e-96934e511846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.147131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c0341-aa2d-4db4-956e-96934e511846 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.158696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 956/1903] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:35.161974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e4eb-512f-489b-8f53-f11e291e75df None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.161974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e4eb-512f-489b-8f53-f11e291e75df None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.161974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e4eb-512f-489b-8f53-f11e291e75df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.175901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f00acb-3d7d-419b-a37c-8e1a5ab2f566 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.180517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8978a-2759-4c76-88bc-46e5e57bec42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.181150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8978a-2759-4c76-88bc-46e5e57bec42 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.181429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8978a-2759-4c76-88bc-46e5e57bec42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.181703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8978a-2759-4c76-88bc-46e5e57bec42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.183734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-36b8978a-2759-4c76-88bc-46e5e57bec42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.193309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3928e4eb-512f-489b-8f53-f11e291e75df None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:35.194688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3928e4eb-512f-489b-8f53-f11e291e75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.198157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8978a-2759-4c76-88bc-46e5e57bec42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.199920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8978a-2759-4c76-88bc-46e5e57bec42 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.205459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 957/1904] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:35.206382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e4eb-512f-489b-8f53-f11e291e75df None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.207710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3928e4eb-512f-489b-8f53-f11e291e75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.212653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 948/1905] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:35.214411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c41e-f8e8-41ba-b22a-5e6155405215 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.214936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c41e-f8e8-41ba-b22a-5e6155405215 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.215360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c41e-f8e8-41ba-b22a-5e6155405215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.221529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e4eb-512f-489b-8f53-f11e291e75df None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.228756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60b21-841b-49b2-b8af-0d5bb2ca3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.229370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60b21-841b-49b2-b8af-0d5bb2ca3718 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.229647 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60b21-841b-49b2-b8af-0d5bb2ca3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.230000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60b21-841b-49b2-b8af-0d5bb2ca3718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.230640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e60b21-841b-49b2-b8af-0d5bb2ca3718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.232433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e60b21-841b-49b2-b8af-0d5bb2ca3718 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.245173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a901c41e-f8e8-41ba-b22a-5e6155405215 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:35.245542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 958/1906] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:35.247090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a901c41e-f8e8-41ba-b22a-5e6155405215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.258271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 949/1907] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:35.261399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60b21-841b-49b2-b8af-0d5bb2ca3718 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.263517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901c41e-f8e8-41ba-b22a-5e6155405215 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.287465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60b21-841b-49b2-b8af-0d5bb2ca3718 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.293837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901c41e-f8e8-41ba-b22a-5e6155405215 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.297116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a01e0-ce86-40bb-a72d-b6283a6b89a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.299250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a01e0-ce86-40bb-a72d-b6283a6b89a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.299642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a01e0-ce86-40bb-a72d-b6283a6b89a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.300012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a01e0-ce86-40bb-a72d-b6283a6b89a8 admin admin] PATH_INFO: `/v3/projects/59a94df0badc4b46a0c22191fe89bc84/users/b069b350b0584e4a8ff88bf923abd1cd/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.312292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.314653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.314963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.315239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.315916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:35.319007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.323685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.324039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a01e0-ce86-40bb-a72d-b6283a6b89a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a94df0badc4b46a0c22191fe89bc84, user_id=b069b350b0584e4a8ff88bf923abd1cd, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.343440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a01e0-ce86-40bb-a72d-b6283a6b89a8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.361129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 950/1908] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:35.366473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.385536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 959/1909] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:35 2022] PUT /identity/v3/projects/59a94df0badc4b46a0c22191fe89bc84/users/b069b350b0584e4a8ff88bf923abd1cd/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:35.396172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3eea1-c819-466a-adfb-7e79b96ee0ac admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.396411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5039-52c9-43c9-bc2f-c97e49464484 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.396868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5039-52c9-43c9-bc2f-c97e49464484 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.397173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5039-52c9-43c9-bc2f-c97e49464484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.468748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e17a5039-52c9-43c9-bc2f-c97e49464484 None None] MFA Rules not processed for user `b069b350b0584e4a8ff88bf923abd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:35.470962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e17a5039-52c9-43c9-bc2f-c97e49464484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.520838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:35.567157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 960/1910] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:35.588456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733fd4-044f-4b10-bb8e-e2ecd8271a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.589092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733fd4-044f-4b10-bb8e-e2ecd8271a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.589540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733fd4-044f-4b10-bb8e-e2ecd8271a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.589808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2733fd4-044f-4b10-bb8e-e2ecd8271a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.590462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2733fd4-044f-4b10-bb8e-e2ecd8271a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.592945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2733fd4-044f-4b10-bb8e-e2ecd8271a96 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.608429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a5039-52c9-43c9-bc2f-c97e49464484 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.610103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e17a5039-52c9-43c9-bc2f-c97e49464484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.666543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 951/1911] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:35 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:35.667766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733fd4-044f-4b10-bb8e-e2ecd8271a96 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.707102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a5039-52c9-43c9-bc2f-c97e49464484 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.755547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2733fd4-044f-4b10-bb8e-e2ecd8271a96 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.755816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:35.762598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.763253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.763557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.763811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.764874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.767242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.770576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa0272-f209-4bf9-8692-4acab2b94ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.771304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0272-f209-4bf9-8692-4acab2b94ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.771650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0272-f209-4bf9-8692-4acab2b94ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.772037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0272-f209-4bf9-8692-4acab2b94ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.798144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 952/1912] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:35 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:35.798144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.800302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.815844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918311-8d8e-45f0-a59c-69b633b2633b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.821969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.822416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.822698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.823054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] PATH_INFO: `/v3/projects/3cf6235da0e74d879e0581dab126f7d3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.824213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf6235da0e74d879e0581dab126f7d3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.826611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.847737 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa0272-f209-4bf9-8692-4acab2b94ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.850119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa0272-f209-4bf9-8692-4acab2b94ae5 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.864573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 961/1913] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:35.874961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa0272-f209-4bf9-8692-4acab2b94ae5 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.888549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa0272-f209-4bf9-8692-4acab2b94ae5 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.909900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf6235da0e74d879e0581dab126f7d3', 'request_id': 'req-5c884fc2-5eb3-441e-b0e6-a93909c78b24'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.922000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf6235da0e74d879e0581dab126f7d3', 'request_id': 'req-5c884fc2-5eb3-441e-b0e6-a93909c78b24'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.936868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf6235da0e74d879e0581dab126f7d3', 'request_id': 'req-5c884fc2-5eb3-441e-b0e6-a93909c78b24'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.963567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] The token cache is being invalidate because project 3cf6235da0e74d879e0581dab126f7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:35.964052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.965572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:35.968008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 953/1914] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:35 2022] DELETE /identity/v3/projects/3cf6235da0e74d879e0581dab126f7d3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:35.968804 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:35.971075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:35.975991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.977513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.977850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.978214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.979046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:35.981780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:35.985902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884fc2-5eb3-441e-b0e6-a93909c78b24 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:35.992269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:35.994170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:35.996052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:35.998957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] PATH_INFO: `/v3/users/b069b350b0584e4a8ff88bf923abd1cd` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:35.999292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 962/1915] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:36.000219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:36.000395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b069b350b0584e4a8ff88bf923abd1cd)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:36.002401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:36.002511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:36.048812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8372-6617-4b3c-80db-6d76a7d0c10e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:36.064408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:36.076367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:36.078358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:36.080839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] PATH_INFO: `/v3/users/27eb500aa43b47cb94330a8d318a86a9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:36.084510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=27eb500aa43b47cb94330a8d318a86a9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:36.087015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:36.103938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:DELETE=12 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:36.156249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b069b350b0584e4a8ff88bf923abd1cd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.171844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b069b350b0584e4a8ff88bf923abd1cd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.172867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b069b350b0584e4a8ff88bf923abd1cd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.174662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b069b350b0584e4a8ff88bf923abd1cd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.212197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b069b350b0584e4a8ff88bf923abd1cd'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.231418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27eb500aa43b47cb94330a8d318a86a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.264825 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27eb500aa43b47cb94330a8d318a86a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.267065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27eb500aa43b47cb94330a8d318a86a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.267806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27eb500aa43b47cb94330a8d318a86a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.276744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 954/1916] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:35 2022] DELETE /identity/v3/users/b069b350b0584e4a8ff88bf923abd1cd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:36.278014 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:36.282656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:36.287023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5355c4c6-e45e-4806-9524-028b26846ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27eb500aa43b47cb94330a8d318a86a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:36.315475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 963/1917] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:35 2022] DELETE /identity/v3/users/27eb500aa43b47cb94330a8d318a86a9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:36.316205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516202-594e-4981-814d-f6f2108f2a95 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:36.316577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516202-594e-4981-814d-f6f2108f2a95 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:36.316935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de516202-594e-4981-814d-f6f2108f2a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:36.326421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:36.350270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-de516202-594e-4981-814d-f6f2108f2a95 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:36.358019 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-de516202-594e-4981-814d-f6f2108f2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:36.380394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b570b-d225-4d57-aea5-9319180c3f41 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:36.473761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:36.475006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:36.475168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 964/1918] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:36.475590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:36.476158 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:36.477031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:36.478637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:36.485840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de516202-594e-4981-814d-f6f2108f2a95 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:36.488844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-de516202-594e-4981-814d-f6f2108f2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:36.494861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 955/1919] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:36.497806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:36.500616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:36.515262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f134-15c1-49d0-a2ec-4c54e35b1347 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:36.520967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d424d-c8e3-442b-a287-65b492e4bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:36.521666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d424d-c8e3-442b-a287-65b492e4bca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:36.521946 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d424d-c8e3-442b-a287-65b492e4bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:36.522226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d424d-c8e3-442b-a287-65b492e4bca5 admin admin] PATH_INFO: `/v3/projects/4d550da0ce1847a8afc6cd0aca5347cd/users/2602727b917047519831eae0dd9e3c42/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:36.542198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d424d-c8e3-442b-a287-65b492e4bca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d550da0ce1847a8afc6cd0aca5347cd, user_id=2602727b917047519831eae0dd9e3c42, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:36.548167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d424d-c8e3-442b-a287-65b492e4bca5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:36.591192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 956/1920] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:36 2022] PUT /identity/v3/projects/4d550da0ce1847a8afc6cd0aca5347cd/users/2602727b917047519831eae0dd9e3c42/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:36.607035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1286-24fd-4e33-a2fc-e72c5fee8196 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:36.607508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1286-24fd-4e33-a2fc-e72c5fee8196 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:36.609551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1286-24fd-4e33-a2fc-e72c5fee8196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:36.620991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de516202-594e-4981-814d-f6f2108f2a95 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:36.658017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c65a1286-24fd-4e33-a2fc-e72c5fee8196 None None] MFA Rules not processed for user `2602727b917047519831eae0dd9e3c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:36.660033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c65a1286-24fd-4e33-a2fc-e72c5fee8196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:36.684867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:36.740125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:36.743424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:36.743711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:36.743990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:36.769836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 957/1921] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:36.775246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1286-24fd-4e33-a2fc-e72c5fee8196 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:36.871962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:36.872168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1286-24fd-4e33-a2fc-e72c5fee8196 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:36.874728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:36.877678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:36.878216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:36.878605 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:36.878918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:36.879589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:36.881552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:36.887105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 965/1922] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:36.888073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:36.889909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:36.904613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:36.920307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 958/1923] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:36 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:36.925954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:36.928170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:36.968774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb609-bfd4-40f4-b6d5-fc1b7b697b3c service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.035271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.035899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.036176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.036445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.038235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.047715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac9ce2-3e46-426f-8df9-414666c3fd4e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.053703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.054671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.056118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.057093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] PATH_INFO: `/v3/projects/7fbb4b1825774b00a544b39d1c2811b0` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.058644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbb4b1825774b00a544b39d1c2811b0)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.061268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.127100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:37.130216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.131897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.134594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbb4b1825774b00a544b39d1c2811b0', 'request_id': 'req-aa807808-ab0a-450b-b746-2a48af4ad942'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.143856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 966/1924] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:37.144839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:37.147856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbb4b1825774b00a544b39d1c2811b0', 'request_id': 'req-aa807808-ab0a-450b-b746-2a48af4ad942'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.159870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c86a9a-841a-4f0d-b332-c6a1335d5797 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.163253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbb4b1825774b00a544b39d1c2811b0', 'request_id': 'req-aa807808-ab0a-450b-b746-2a48af4ad942'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.187518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] The token cache is being invalidate because project 7fbb4b1825774b00a544b39d1c2811b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:37.187886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.188900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-aa807808-ab0a-450b-b746-2a48af4ad942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.194993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 959/1925] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:36 2022] DELETE /identity/v3/projects/7fbb4b1825774b00a544b39d1c2811b0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:37.197023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794b6f-e743-49a7-be71-5348a2927f0e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.197305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794b6f-e743-49a7-be71-5348a2927f0e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.197575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af794b6f-e743-49a7-be71-5348a2927f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.228668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-af794b6f-e743-49a7-be71-5348a2927f0e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:37.230158 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-af794b6f-e743-49a7-be71-5348a2927f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.263242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.264244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.264724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.265197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.266053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.268502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.305572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 967/1926] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:37 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:37.309418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:37.312246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.329238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:37.342624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b0bd6-5765-4378-b942-a8f1e6564dde admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.344317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 960/1927] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:37.352031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794b6f-e743-49a7-be71-5348a2927f0e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:37.355558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-af794b6f-e743-49a7-be71-5348a2927f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.379679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b119f-871e-44f3-9ff4-aad24aeaafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.379679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b119f-871e-44f3-9ff4-aad24aeaafc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.379679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b119f-871e-44f3-9ff4-aad24aeaafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.379679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b119f-871e-44f3-9ff4-aad24aeaafc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.380016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b119f-871e-44f3-9ff4-aad24aeaafc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.380016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b119f-871e-44f3-9ff4-aad24aeaafc8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.380016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 968/1928] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:37.380016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6c5af-26f3-445d-ae78-559dadfb9aa5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.380016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6c5af-26f3-445d-ae78-559dadfb9aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.380016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6c5af-26f3-445d-ae78-559dadfb9aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.387472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af794b6f-e743-49a7-be71-5348a2927f0e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.394866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.395630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.396594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.396887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] PATH_INFO: `/v3/projects/59a94df0badc4b46a0c22191fe89bc84` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.398257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a94df0badc4b46a0c22191fe89bc84)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.402763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.414818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fea6c5af-26f3-445d-ae78-559dadfb9aa5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:37.416514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fea6c5af-26f3-445d-ae78-559dadfb9aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.439059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 969/1929] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:37.440284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89696c-69d4-4307-9457-39dc4521e431 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.440515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89696c-69d4-4307-9457-39dc4521e431 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.440788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89696c-69d4-4307-9457-39dc4521e431 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.442168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 970/1930] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:01:37.443070 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89696c-69d4-4307-9457-39dc4521e431 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:37.474355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89696c-69d4-4307-9457-39dc4521e431 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.489979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a94df0badc4b46a0c22191fe89bc84', 'request_id': 'req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.497388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a94df0badc4b46a0c22191fe89bc84', 'request_id': 'req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.512626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a94df0badc4b46a0c22191fe89bc84', 'request_id': 'req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.527474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] The token cache is being invalidate because project 59a94df0badc4b46a0c22191fe89bc84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:37.527892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.528932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:37.532973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 961/1931] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:37 2022] DELETE /identity/v3/projects/59a94df0badc4b46a0c22191fe89bc84 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:37.534111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:37.535884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.593522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d25afd-ff98-45a2-b771-d9968dcca15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.594870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25afd-ff98-45a2-b771-d9968dcca15c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.595358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25afd-ff98-45a2-b771-d9968dcca15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.595701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25afd-ff98-45a2-b771-d9968dcca15c admin admin] PATH_INFO: `/v3/projects/ca720bed25b24748be999180b6f786dd/users/57e21d61acf74f2cb60fb4a73a2b69fc/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.618610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d25afd-ff98-45a2-b771-d9968dcca15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca720bed25b24748be999180b6f786dd, user_id=57e21d61acf74f2cb60fb4a73a2b69fc, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.622609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d25afd-ff98-45a2-b771-d9968dcca15c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.662630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 971/1932] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:37 2022] PUT /identity/v3/projects/ca720bed25b24748be999180b6f786dd/users/57e21d61acf74f2cb60fb4a73a2b69fc/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:37.664064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e49f63-1a1a-4df9-87f5-d5f68c6aeef6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.665104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e49f63-1a1a-4df9-87f5-d5f68c6aeef6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.665569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e49f63-1a1a-4df9-87f5-d5f68c6aeef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.684858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:37.694566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911efb48-68e0-4d56-9c3d-02a78ab5aaf7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.707627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-70e49f63-1a1a-4df9-87f5-d5f68c6aeef6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:37.709845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-70e49f63-1a1a-4df9-87f5-d5f68c6aeef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.802577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7629b64-f65a-42ef-a4f2-116fdf46583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.803356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7629b64-f65a-42ef-a4f2-116fdf46583b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.803706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7629b64-f65a-42ef-a4f2-116fdf46583b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.804048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7629b64-f65a-42ef-a4f2-116fdf46583b admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.804789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7629b64-f65a-42ef-a4f2-116fdf46583b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:37.805968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7629b64-f65a-42ef-a4f2-116fdf46583b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.807782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7629b64-f65a-42ef-a4f2-116fdf46583b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.821453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 962/1933] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:37.824280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09967-b5a4-4684-b5ae-c027b13fe319 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.824641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09967-b5a4-4684-b5ae-c027b13fe319 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.824994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09967-b5a4-4684-b5ae-c027b13fe319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.841218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 972/1934] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:37.842262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e49f63-1a1a-4df9-87f5-d5f68c6aeef6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:37.843605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-70e49f63-1a1a-4df9-87f5-d5f68c6aeef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.849381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-29b09967-b5a4-4684-b5ae-c027b13fe319 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:37.850368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-29b09967-b5a4-4684-b5ae-c027b13fe319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.856050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e49f63-1a1a-4df9-87f5-d5f68c6aeef6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.860832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5566a-9925-4ebe-a5d7-7ee5cd47e55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.861442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5566a-9925-4ebe-a5d7-7ee5cd47e55b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.861717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5566a-9925-4ebe-a5d7-7ee5cd47e55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.862049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5566a-9925-4ebe-a5d7-7ee5cd47e55b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.862617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5566a-9925-4ebe-a5d7-7ee5cd47e55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.864362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5566a-9925-4ebe-a5d7-7ee5cd47e55b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.883163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 973/1935] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:37.883163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5566a-9925-4ebe-a5d7-7ee5cd47e55b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:37.899379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5566a-9925-4ebe-a5d7-7ee5cd47e55b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:37.909241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c9655-9fc5-41dc-97ed-5e9d356418e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:37.910194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9655-9fc5-41dc-97ed-5e9d356418e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.910194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9655-9fc5-41dc-97ed-5e9d356418e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.910516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9655-9fc5-41dc-97ed-5e9d356418e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.911191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c9655-9fc5-41dc-97ed-5e9d356418e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:37.913216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c9655-9fc5-41dc-97ed-5e9d356418e6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:37.964333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 974/1936] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:37 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:37.965771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3deb0-8906-4594-988d-e4660def7177 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:37.966148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3deb0-8906-4594-988d-e4660def7177 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:37.966504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3deb0-8906-4594-988d-e4660def7177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:37.982880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 963/1937] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:01:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:37.984421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b09967-b5a4-4684-b5ae-c027b13fe319 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:37.987645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-48d3deb0-8906-4594-988d-e4660def7177 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:37.988982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-48d3deb0-8906-4594-988d-e4660def7177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:37.997729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b09967-b5a4-4684-b5ae-c027b13fe319 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.044146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:38.088944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.089558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.089845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.090096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] PATH_INFO: `/v3/projects/ca720bed25b24748be999180b6f786dd/users/57e21d61acf74f2cb60fb4a73a2b69fc/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.092110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca720bed25b24748be999180b6f786dd, user_id=57e21d61acf74f2cb60fb4a73a2b69fc, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.096034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.096577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 975/1938] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:38.097424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3deb0-8906-4594-988d-e4660def7177 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.109366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3deb0-8906-4594-988d-e4660def7177 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.114841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 964/1939] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:37 2022] PUT /identity/v3/projects/ca720bed25b24748be999180b6f786dd/users/57e21d61acf74f2cb60fb4a73a2b69fc/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:38.117274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.121664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:38.159680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:38.188073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc700e-d61d-4e4e-8651-af2d1096cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.188718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc700e-d61d-4e4e-8651-af2d1096cedc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.188946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc700e-d61d-4e4e-8651-af2d1096cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.189210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc700e-d61d-4e4e-8651-af2d1096cedc admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.189835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc700e-d61d-4e4e-8651-af2d1096cedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.191785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc700e-d61d-4e4e-8651-af2d1096cedc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.216277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 976/1940] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:38 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:38.217561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc700e-d61d-4e4e-8651-af2d1096cedc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.218089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fca7b1-2b6f-41b3-b8eb-d12c37d5db5b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.224182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa678038-f7a4-40e9-bbd6-bf286365bcc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.224932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa678038-f7a4-40e9-bbd6-bf286365bcc7 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.225202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa678038-f7a4-40e9-bbd6-bf286365bcc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.225534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa678038-f7a4-40e9-bbd6-bf286365bcc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.228274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc700e-d61d-4e4e-8651-af2d1096cedc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.233047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.233830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.234102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.234420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.235092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:38.235396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.236308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa678038-f7a4-40e9-bbd6-bf286365bcc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.236958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.238017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa678038-f7a4-40e9-bbd6-bf286365bcc7 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.249120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 965/1941] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:38.250532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b040b4-8aaa-4508-8dbc-eaa9c9205c6c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.250701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 977/1942] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:38.251614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.254417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b040b4-8aaa-4508-8dbc-eaa9c9205c6c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.254692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b040b4-8aaa-4508-8dbc-eaa9c9205c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.265689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9bf69-7f44-48e5-bed3-6be3cd07b3e5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.273315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f989330-0057-4363-81ee-17bc1215dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.273315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f989330-0057-4363-81ee-17bc1215dc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.273315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f989330-0057-4363-81ee-17bc1215dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.273728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f989330-0057-4363-81ee-17bc1215dc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.275443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f989330-0057-4363-81ee-17bc1215dc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.277087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f989330-0057-4363-81ee-17bc1215dc93 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.290652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-55b040b4-8aaa-4508-8dbc-eaa9c9205c6c None None] MFA Rules not processed for user `57e21d61acf74f2cb60fb4a73a2b69fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:38.291296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 978/1943] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:38.292357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f989330-0057-4363-81ee-17bc1215dc93 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.294769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-55b040b4-8aaa-4508-8dbc-eaa9c9205c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:38.305265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f989330-0057-4363-81ee-17bc1215dc93 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.312499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f578412-d272-4f15-8a86-5860c6f7caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.312974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578412-d272-4f15-8a86-5860c6f7caed admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.313292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578412-d272-4f15-8a86-5860c6f7caed admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.313526 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578412-d272-4f15-8a86-5860c6f7caed admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.314277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f578412-d272-4f15-8a86-5860c6f7caed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.316381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f578412-d272-4f15-8a86-5860c6f7caed admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.350275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 979/1944] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:38 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:38.351293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f578412-d272-4f15-8a86-5860c6f7caed admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.396243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 966/1945] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:38.397028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b040b4-8aaa-4508-8dbc-eaa9c9205c6c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.410726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b040b4-8aaa-4508-8dbc-eaa9c9205c6c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.451152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f578412-d272-4f15-8a86-5860c6f7caed admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.457120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.457721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.457994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.458259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.458924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.460973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.475784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 980/1946] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:38.475784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.475784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:38.490453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d66fac-dcf4-4e47-8045-c9dc71c7bc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.491106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66fac-dcf4-4e47-8045-c9dc71c7bc43 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.491385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66fac-dcf4-4e47-8045-c9dc71c7bc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.491654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d66fac-dcf4-4e47-8045-c9dc71c7bc43 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.492368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d66fac-dcf4-4e47-8045-c9dc71c7bc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.494368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d66fac-dcf4-4e47-8045-c9dc71c7bc43 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.509972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:38.528222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 967/1947] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:38 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:38.529331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d66fac-dcf4-4e47-8045-c9dc71c7bc43 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.542561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d66fac-dcf4-4e47-8045-c9dc71c7bc43 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.549295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711058e7-1827-4d05-8a9a-730fd9d588a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.549952 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711058e7-1827-4d05-8a9a-730fd9d588a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.550226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711058e7-1827-4d05-8a9a-730fd9d588a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.550493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711058e7-1827-4d05-8a9a-730fd9d588a6 admin admin] PATH_INFO: `/v3/projects/2a80a0a28e09448d8d15e301c6f244a8/users/bd6517b64f02486c90ed1160dbccf795/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.562051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16acfa-d31d-4657-a9ae-5b4bfb414869 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.567778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ba469-dfe0-4f54-a091-5af0f16350b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.579871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba469-dfe0-4f54-a091-5af0f16350b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.580201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba469-dfe0-4f54-a091-5af0f16350b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.580561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba469-dfe0-4f54-a091-5af0f16350b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.590302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711058e7-1827-4d05-8a9a-730fd9d588a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a80a0a28e09448d8d15e301c6f244a8, user_id=bd6517b64f02486c90ed1160dbccf795, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.597373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711058e7-1827-4d05-8a9a-730fd9d588a6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.615026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:38.635194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 968/1948] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:38 2022] PUT /identity/v3/projects/2a80a0a28e09448d8d15e301c6f244a8/users/bd6517b64f02486c90ed1160dbccf795/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:38.635194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711058e7-1827-4d05-8a9a-730fd9d588a6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.729159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba469-dfe0-4f54-a091-5af0f16350b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.733159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba469-dfe0-4f54-a091-5af0f16350b3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.752660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711058e7-1827-4d05-8a9a-730fd9d588a6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.759741 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e06f7-ecc2-423a-a6c8-601636fa27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.760694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e06f7-ecc2-423a-a6c8-601636fa27ea admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.761237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 981/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:38.763657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205f44-470e-41da-9db4-93b6e5c3b5e9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.763945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205f44-470e-41da-9db4-93b6e5c3b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.766344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205f44-470e-41da-9db4-93b6e5c3b5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.772333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e06f7-ecc2-423a-a6c8-601636fa27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.774971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e06f7-ecc2-423a-a6c8-601636fa27ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.775907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e06f7-ecc2-423a-a6c8-601636fa27ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.782725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e06f7-ecc2-423a-a6c8-601636fa27ea admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.874792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 969/1950] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:38.874792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e06f7-ecc2-423a-a6c8-601636fa27ea admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:38.882401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ae205f44-470e-41da-9db4-93b6e5c3b5e9 None None] MFA Rules not processed for user `bd6517b64f02486c90ed1160dbccf795`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:38.885099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae205f44-470e-41da-9db4-93b6e5c3b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:38.908119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e06f7-ecc2-423a-a6c8-601636fa27ea admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:38.915573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad837e-0507-44fc-b2c8-848288b4e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:38.917140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad837e-0507-44fc-b2c8-848288b4e9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:38.917740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad837e-0507-44fc-b2c8-848288b4e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:38.918180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad837e-0507-44fc-b2c8-848288b4e9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:38.919164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad837e-0507-44fc-b2c8-848288b4e9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:38.921211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad837e-0507-44fc-b2c8-848288b4e9b6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:38.938662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 970/1951] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:38.939913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad837e-0507-44fc-b2c8-848288b4e9b6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.015557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad837e-0507-44fc-b2c8-848288b4e9b6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.020714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62571ea0-69ac-446d-897d-c8998f27b482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.021774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62571ea0-69ac-446d-897d-c8998f27b482 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.022257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62571ea0-69ac-446d-897d-c8998f27b482 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.022651 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62571ea0-69ac-446d-897d-c8998f27b482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.025711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-62571ea0-69ac-446d-897d-c8998f27b482 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:39.045062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 982/1952] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:39.046501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae205f44-470e-41da-9db4-93b6e5c3b5e9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.061523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae205f44-470e-41da-9db4-93b6e5c3b5e9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.069500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6934-adb4-45ef-a1f1-a7ca9d0cff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.070172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6934-adb4-45ef-a1f1-a7ca9d0cff05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.071965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6934-adb4-45ef-a1f1-a7ca9d0cff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.072221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6934-adb4-45ef-a1f1-a7ca9d0cff05 admin admin] PATH_INFO: `/v3/projects/cd6a8e4991c5438099bfe6e2cc308a93/users/9daea77e23e749a0b6cd360b6b0adcc7/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.091609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad6934-adb4-45ef-a1f1-a7ca9d0cff05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6a8e4991c5438099bfe6e2cc308a93, user_id=9daea77e23e749a0b6cd360b6b0adcc7, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.095724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad6934-adb4-45ef-a1f1-a7ca9d0cff05 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.120619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 983/1953] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:39 2022] PUT /identity/v3/projects/cd6a8e4991c5438099bfe6e2cc308a93/users/9daea77e23e749a0b6cd360b6b0adcc7/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:39.121866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6934-adb4-45ef-a1f1-a7ca9d0cff05 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.155825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62571ea0-69ac-446d-897d-c8998f27b482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.157455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62571ea0-69ac-446d-897d-c8998f27b482 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.169727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 971/1954] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:39.171190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977665f7-450b-451f-a975-be4cc97b5b28 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.171558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977665f7-450b-451f-a975-be4cc97b5b28 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.172417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977665f7-450b-451f-a975-be4cc97b5b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.211863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:39.237479 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-977665f7-450b-451f-a975-be4cc97b5b28 None None] MFA Rules not processed for user `9daea77e23e749a0b6cd360b6b0adcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:39.238706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-977665f7-450b-451f-a975-be4cc97b5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:39.280496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6934-adb4-45ef-a1f1-a7ca9d0cff05 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.286238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d477-316c-490b-bd87-2504f2012235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.286957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d477-316c-490b-bd87-2504f2012235 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.287239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d477-316c-490b-bd87-2504f2012235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.287562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d477-316c-490b-bd87-2504f2012235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.288207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d477-316c-490b-bd87-2504f2012235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.290861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d477-316c-490b-bd87-2504f2012235 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.305632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:39.341365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 984/1955] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:39 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:39.346551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d477-316c-490b-bd87-2504f2012235 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.388930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 972/1956] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:39.441757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d477-316c-490b-bd87-2504f2012235 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.451570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977665f7-450b-451f-a975-be4cc97b5b28 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.452420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a110cd3-dd42-474f-862c-788fd4ebc368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.453519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-977665f7-450b-451f-a975-be4cc97b5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:39.454207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a110cd3-dd42-474f-862c-788fd4ebc368 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.454640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a110cd3-dd42-474f-862c-788fd4ebc368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.455111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a110cd3-dd42-474f-862c-788fd4ebc368 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.456686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a110cd3-dd42-474f-862c-788fd4ebc368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.458743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a110cd3-dd42-474f-862c-788fd4ebc368 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.491116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 985/1957] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:39 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:39.494823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a110cd3-dd42-474f-862c-788fd4ebc368 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.513558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a110cd3-dd42-474f-862c-788fd4ebc368 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.521455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cef23-50fe-418b-80fa-96dddf75b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.523000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cef23-50fe-418b-80fa-96dddf75b5ae admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.524148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cef23-50fe-418b-80fa-96dddf75b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.524608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cef23-50fe-418b-80fa-96dddf75b5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.525431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cef23-50fe-418b-80fa-96dddf75b5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.528531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cef23-50fe-418b-80fa-96dddf75b5ae admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.542009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 986/1958] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:01:39.546447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cef23-50fe-418b-80fa-96dddf75b5ae admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.547113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977665f7-450b-451f-a975-be4cc97b5b28 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.570779 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cef23-50fe-418b-80fa-96dddf75b5ae admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.576878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f2462-7732-4254-ae98-2cdcf4ccc5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.577614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f2462-7732-4254-ae98-2cdcf4ccc5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.578080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f2462-7732-4254-ae98-2cdcf4ccc5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.578189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f2462-7732-4254-ae98-2cdcf4ccc5dc admin admin] PATH_INFO: `/v3/projects/64d3778c9bd64606b90c15fa95d96f27/users/007fd1594e8249fa82fd0f315f7b9530/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.612113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f2462-7732-4254-ae98-2cdcf4ccc5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d3778c9bd64606b90c15fa95d96f27, user_id=007fd1594e8249fa82fd0f315f7b9530, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.614920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f2462-7732-4254-ae98-2cdcf4ccc5dc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.633921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 987/1959] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:39 2022] PUT /identity/v3/projects/64d3778c9bd64606b90c15fa95d96f27/users/007fd1594e8249fa82fd0f315f7b9530/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:39.647186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f2462-7732-4254-ae98-2cdcf4ccc5dc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.654809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776c1e0-fded-433f-b889-e0ee61b1ac77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.655663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776c1e0-fded-433f-b889-e0ee61b1ac77 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.655951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776c1e0-fded-433f-b889-e0ee61b1ac77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.656226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776c1e0-fded-433f-b889-e0ee61b1ac77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.729296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776c1e0-fded-433f-b889-e0ee61b1ac77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.729702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f2462-7732-4254-ae98-2cdcf4ccc5dc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.730987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776c1e0-fded-433f-b889-e0ee61b1ac77 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.734705 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c5dcf-6353-4dbd-9305-02cf7ea0cd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.735416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5dcf-6353-4dbd-9305-02cf7ea0cd47 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.735756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5dcf-6353-4dbd-9305-02cf7ea0cd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.736114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5dcf-6353-4dbd-9305-02cf7ea0cd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.736816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c5dcf-6353-4dbd-9305-02cf7ea0cd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.738543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c5dcf-6353-4dbd-9305-02cf7ea0cd47 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.740892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 973/1960] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:39.754355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 988/1961] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:39.755593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776c1e0-fded-433f-b889-e0ee61b1ac77 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.766899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776c1e0-fded-433f-b889-e0ee61b1ac77 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:39.771599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:39.772312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.772532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.772804 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] PATH_INFO: `/v3/projects/64d3778c9bd64606b90c15fa95d96f27/users/007fd1594e8249fa82fd0f315f7b9530/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.775252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d3778c9bd64606b90c15fa95d96f27, user_id=007fd1594e8249fa82fd0f315f7b9530, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:39.777934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:39.788916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 974/1962] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:39 2022] PUT /identity/v3/projects/64d3778c9bd64606b90c15fa95d96f27/users/007fd1594e8249fa82fd0f315f7b9530/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:39.800818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c368f-5971-4d82-94f9-dd6ac9251612 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:39.801171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c368f-5971-4d82-94f9-dd6ac9251612 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:39.801512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c368f-5971-4d82-94f9-dd6ac9251612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:39.825614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:39.838777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-095c368f-5971-4d82-94f9-dd6ac9251612 None None] MFA Rules not processed for user `007fd1594e8249fa82fd0f315f7b9530`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:39.840082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-095c368f-5971-4d82-94f9-dd6ac9251612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:39.916869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.919447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:39.925523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 989/1963] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:39.938190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c368f-5971-4d82-94f9-dd6ac9251612 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:39.956004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:40.011014 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade74c-73c6-4cbe-88df-42fce2a14e8d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:40.014404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c368f-5971-4d82-94f9-dd6ac9251612 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:40.017358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:40.018564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b6367-be42-4e96-a935-e5f65b072693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:40.018711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:40.019148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:40.019276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6367-be42-4e96-a935-e5f65b072693 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:40.019552 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6367-be42-4e96-a935-e5f65b072693 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:40.019837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6367-be42-4e96-a935-e5f65b072693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:40.019954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] PATH_INFO: `/v3/users/a39183f4544342b7bcf62bd12f3056a0` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:40.021733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39183f4544342b7bcf62bd12f3056a0)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:40.025150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:40.112199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b6367-be42-4e96-a935-e5f65b072693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:40.114972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b6367-be42-4e96-a935-e5f65b072693 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:40.128215 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 990/1964] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:40.133413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39183f4544342b7bcf62bd12f3056a0'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:40.145760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39183f4544342b7bcf62bd12f3056a0'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:40.146432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39183f4544342b7bcf62bd12f3056a0'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:40.147092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39183f4544342b7bcf62bd12f3056a0'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:40.163132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39183f4544342b7bcf62bd12f3056a0'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:40.207203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 975/1965] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:39 2022] DELETE /identity/v3/users/a39183f4544342b7bcf62bd12f3056a0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:40.207717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474615c-f9f0-4915-a004-ba5d748e19f6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:40.207717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474615c-f9f0-4915-a004-ba5d748e19f6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:40.207717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474615c-f9f0-4915-a004-ba5d748e19f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:40.243850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9474615c-f9f0-4915-a004-ba5d748e19f6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:40.250529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9474615c-f9f0-4915-a004-ba5d748e19f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:40.412715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:40.444659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 991/1966] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:40.457737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:40.459951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:40.547676 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb2764-964a-4379-b557-d6583d363127 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:40.552378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e118c2-393d-49e1-aa75-2bd551a437a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:40.553629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e118c2-393d-49e1-aa75-2bd551a437a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:40.553939 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e118c2-393d-49e1-aa75-2bd551a437a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:40.554543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e118c2-393d-49e1-aa75-2bd551a437a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:40.591120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e118c2-393d-49e1-aa75-2bd551a437a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:40.592424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e118c2-393d-49e1-aa75-2bd551a437a9 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:40.610169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 976/1967] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:41.058912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474615c-f9f0-4915-a004-ba5d748e19f6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:41.061335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9474615c-f9f0-4915-a004-ba5d748e19f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:41.078084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474615c-f9f0-4915-a004-ba5d748e19f6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:41.086549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:41.087271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:41.087551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:41.087824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] PATH_INFO: `/v3/projects/e6972dae72484bff86dfab6fc29869a0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:41.089717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6972dae72484bff86dfab6fc29869a0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:41.092275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:41.156090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6972dae72484bff86dfab6fc29869a0', 'request_id': 'req-f49f1898-43ea-4204-a944-4d783f1d7b48'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.165173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6972dae72484bff86dfab6fc29869a0', 'request_id': 'req-f49f1898-43ea-4204-a944-4d783f1d7b48'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.175954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6972dae72484bff86dfab6fc29869a0', 'request_id': 'req-f49f1898-43ea-4204-a944-4d783f1d7b48'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.191562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] The token cache is being invalidate because project e6972dae72484bff86dfab6fc29869a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:41.191829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.192495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.194203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 992/1968] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:41 2022] DELETE /identity/v3/projects/e6972dae72484bff86dfab6fc29869a0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:41.198684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e118c2-393d-49e1-aa75-2bd551a437a9 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:41.208936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e118c2-393d-49e1-aa75-2bd551a437a9 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:41.268786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:41.290188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:41.291435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:41.292216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:41.292815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] PATH_INFO: `/v3/users/b231c36890824fddbd26d93e63b3f245` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:41.294115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b231c36890824fddbd26d93e63b3f245)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:41.296275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:41.404321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b231c36890824fddbd26d93e63b3f245'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.420848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b231c36890824fddbd26d93e63b3f245'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.421669 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b231c36890824fddbd26d93e63b3f245'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.422517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b231c36890824fddbd26d93e63b3f245'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.435440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c6f40272-13f4-4e1a-93b4-6e750d2d92d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b231c36890824fddbd26d93e63b3f245'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.463660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 977/1969] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:41 2022] DELETE /identity/v3/users/b231c36890824fddbd26d93e63b3f245 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:41.574280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:41.575794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:41.591153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f1898-43ea-4204-a944-4d783f1d7b48 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:41.676205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:41.677052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:41.677337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:41.677608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] PATH_INFO: `/v3/users/6101e0b800d540b296c5c5c59f507b29` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:41.679520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6101e0b800d540b296c5c5c59f507b29)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:41.683404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:41.769366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6101e0b800d540b296c5c5c59f507b29'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.781012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6101e0b800d540b296c5c5c59f507b29'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.782381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6101e0b800d540b296c5c5c59f507b29'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.783167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6101e0b800d540b296c5c5c59f507b29'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.796275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6101e0b800d540b296c5c5c59f507b29'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:41.816463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:41.838087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 993/1970] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:41 2022] DELETE /identity/v3/users/6101e0b800d540b296c5c5c59f507b29 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:41.842523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f1fe4-c07a-42a5-934b-79cafbaea0b5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:41.842953 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f1fe4-c07a-42a5-934b-79cafbaea0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:41.843312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f1fe4-c07a-42a5-934b-79cafbaea0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:41.869230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ff9f1fe4-c07a-42a5-934b-79cafbaea0b5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:41.870570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ff9f1fe4-c07a-42a5-934b-79cafbaea0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:41.953008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 978/1971] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:41.977804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:41.980395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.012480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f1fe4-c07a-42a5-934b-79cafbaea0b5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.014025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ff9f1fe4-c07a-42a5-934b-79cafbaea0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.032306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f1fe4-c07a-42a5-934b-79cafbaea0b5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.040904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.042310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.042888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.043681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] PATH_INFO: `/v3/projects/3cf5c47836764cee995a6a13e2b355a2` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.045047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf5c47836764cee995a6a13e2b355a2)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.048005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.111564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf5c47836764cee995a6a13e2b355a2', 'request_id': 'req-cb633767-2329-4d77-b7d3-7fde1454e17d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.117467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf5c47836764cee995a6a13e2b355a2', 'request_id': 'req-cb633767-2329-4d77-b7d3-7fde1454e17d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.121314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:42.124294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969082f-9fe4-40ec-bb64-892bd0f0d9f9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.126070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf5c47836764cee995a6a13e2b355a2', 'request_id': 'req-cb633767-2329-4d77-b7d3-7fde1454e17d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.142053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] The token cache is being invalidate because project 3cf5c47836764cee995a6a13e2b355a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:42.142343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.143037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cb633767-2329-4d77-b7d3-7fde1454e17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.144674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 979/1972] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:42 2022] DELETE /identity/v3/projects/3cf5c47836764cee995a6a13e2b355a2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:42.150112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feb9f6-94e0-44fd-b0cc-1c73c9111697 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.150395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feb9f6-94e0-44fd-b0cc-1c73c9111697 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.150668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feb9f6-94e0-44fd-b0cc-1c73c9111697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.170126 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b6feb9f6-94e0-44fd-b0cc-1c73c9111697 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:42.171360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6feb9f6-94e0-44fd-b0cc-1c73c9111697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.176136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.176762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.177025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.177292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.179287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.236330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 980/1973] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:42.246110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7212b-48d0-49f2-bc54-795c2aedf677 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.246393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7212b-48d0-49f2-bc54-795c2aedf677 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.246675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7212b-48d0-49f2-bc54-795c2aedf677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.252555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.253989 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.264987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 994/1974] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:42.267472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-35a7212b-48d0-49f2-bc54-795c2aedf677 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:42.268922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-35a7212b-48d0-49f2-bc54-795c2aedf677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.282349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 981/1975] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:42.283515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.294362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223aa1-f6e5-4f2d-931a-cc8176792e83 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.299310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.300044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.300299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.300959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.301311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:42.301617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.303366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.317212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 995/1976] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:42.321770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7212b-48d0-49f2-bc54-795c2aedf677 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.334057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7212b-48d0-49f2-bc54-795c2aedf677 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.341036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ea755-bc87-46ba-ba11-135d266207ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.341799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ea755-bc87-46ba-ba11-135d266207ea admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.342078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ea755-bc87-46ba-ba11-135d266207ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.342349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ea755-bc87-46ba-ba11-135d266207ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.343015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ea755-bc87-46ba-ba11-135d266207ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.344929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ea755-bc87-46ba-ba11-135d266207ea admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.388760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 982/1977] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:42 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:42.389860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.421576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb699f-e138-4f55-b36a-32587cc9ce82 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.498346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:42.527318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74209610-18da-408b-b581-276c27aede17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.528062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209610-18da-408b-b581-276c27aede17 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.528412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209610-18da-408b-b581-276c27aede17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.528786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209610-18da-408b-b581-276c27aede17 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.531769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74209610-18da-408b-b581-276c27aede17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.533706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74209610-18da-408b-b581-276c27aede17 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.568068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ea755-bc87-46ba-ba11-135d266207ea admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.569985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 996/1978] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:42 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:42.580083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ea755-bc87-46ba-ba11-135d266207ea admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.585514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.586962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.587383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.587747 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.588596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.590445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.603003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 983/1979] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:42.609445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74209610-18da-408b-b581-276c27aede17 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.620342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.624719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74209610-18da-408b-b581-276c27aede17 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.626302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.647283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002da77-070b-438b-aa78-89c1e0a175b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.647909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002da77-070b-438b-aa78-89c1e0a175b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.648280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002da77-070b-438b-aa78-89c1e0a175b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.649128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002da77-070b-438b-aa78-89c1e0a175b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.649791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002da77-070b-438b-aa78-89c1e0a175b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.651412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002da77-070b-438b-aa78-89c1e0a175b8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.666308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 997/1980] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:42.671158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002da77-070b-438b-aa78-89c1e0a175b8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.678000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe394f-16cb-44f1-a78a-b5a2a4eb8854 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.690522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002da77-070b-438b-aa78-89c1e0a175b8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:42.693858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.694581 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.695068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.695542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] PATH_INFO: `/v3/projects/93482262b7414435be1fe7079f2c68c5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.695914 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc0116-2214-4d0b-904e-eda866fd83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:42.697403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc0116-2214-4d0b-904e-eda866fd83c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.697732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc0116-2214-4d0b-904e-eda866fd83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.698009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc0116-2214-4d0b-904e-eda866fd83c0 admin admin] PATH_INFO: `/v3/projects/c166ed4284a64bbebfc1c1f853a89918/users/9b776d85a5a84e899d28fd6fe28b7d06/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.698294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=93482262b7414435be1fe7079f2c68c5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.700464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.717108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc0116-2214-4d0b-904e-eda866fd83c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c166ed4284a64bbebfc1c1f853a89918, user_id=9b776d85a5a84e899d28fd6fe28b7d06, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:42.721537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc0116-2214-4d0b-904e-eda866fd83c0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:42.743734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 998/1981] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:42 2022] PUT /identity/v3/projects/c166ed4284a64bbebfc1c1f853a89918/users/9b776d85a5a84e899d28fd6fe28b7d06/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:42.756928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f05e0-269f-4c7f-be7e-78cfd343ff72 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:42.757216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f05e0-269f-4c7f-be7e-78cfd343ff72 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:42.757999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f05e0-269f-4c7f-be7e-78cfd343ff72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:42.802713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93482262b7414435be1fe7079f2c68c5', 'request_id': 'req-4fa2c842-4d99-495e-9859-1616541cb0dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.812324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2d7f05e0-269f-4c7f-be7e-78cfd343ff72 None None] MFA Rules not processed for user `9b776d85a5a84e899d28fd6fe28b7d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:42.813959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93482262b7414435be1fe7079f2c68c5', 'request_id': 'req-4fa2c842-4d99-495e-9859-1616541cb0dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.814249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d7f05e0-269f-4c7f-be7e-78cfd343ff72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.837216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93482262b7414435be1fe7079f2c68c5', 'request_id': 'req-4fa2c842-4d99-495e-9859-1616541cb0dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.855062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] The token cache is being invalidate because project 93482262b7414435be1fe7079f2c68c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:42.855371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.856010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:42.861366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 984/1982] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:42 2022] DELETE /identity/v3/projects/93482262b7414435be1fe7079f2c68c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:42.862850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.864293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.909317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 999/1983] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:42.915350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f05e0-269f-4c7f-be7e-78cfd343ff72 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:42.917884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d7f05e0-269f-4c7f-be7e-78cfd343ff72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:42.961382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:43.027902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2c842-4d99-495e-9859-1616541cb0dc admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:43.033853 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:43.034820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:43.035271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:43.035694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] PATH_INFO: `/v3/users/2dc579d4ee7940d98f1efcfb3767f221` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:43.037002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc579d4ee7940d98f1efcfb3767f221)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:43.039797 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:43.072659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f05e0-269f-4c7f-be7e-78cfd343ff72 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:43.085268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:43.087836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:43.088127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:43.088398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:43.089240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:43.096361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:43.162012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1000/1984] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:42 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:43.165155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:43.169145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:43.176451 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc579d4ee7940d98f1efcfb3767f221'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.196493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:43.196682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc579d4ee7940d98f1efcfb3767f221'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.199601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc579d4ee7940d98f1efcfb3767f221'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.199601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc579d4ee7940d98f1efcfb3767f221'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.220988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc579d4ee7940d98f1efcfb3767f221'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.270928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 985/1985] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:42 2022] DELETE /identity/v3/users/2dc579d4ee7940d98f1efcfb3767f221 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:43.271652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:43.278092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:43.341096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b497298-c34a-4948-b969-67c0b5e4c594 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:43.421282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af4219-931a-4865-8bfa-3cf552f38e79 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:43.435549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:43.438018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:43.438567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:43.438877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:43.440823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:43.445240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:43.501173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 986/1986] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:43 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:43.503238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:43.507184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:43.531927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:43.534630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cef34-e66e-4f2f-873f-52e979b220aa admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:43.536289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:43.536748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:43.537658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] PATH_INFO: `/v3/users/bd6517b64f02486c90ed1160dbccf795` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:43.543484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:43.543891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6517b64f02486c90ed1160dbccf795)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:43.544323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:43.544731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:43.545101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] PATH_INFO: `/v3/users/2602727b917047519831eae0dd9e3c42` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:43.546452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2602727b917047519831eae0dd9e3c42)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:43.548679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:43.549297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:43.657638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:43.676444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6517b64f02486c90ed1160dbccf795'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.688238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2602727b917047519831eae0dd9e3c42'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.689925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6517b64f02486c90ed1160dbccf795'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.691177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6517b64f02486c90ed1160dbccf795'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.692269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6517b64f02486c90ed1160dbccf795'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.706003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6517b64f02486c90ed1160dbccf795'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.709707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2602727b917047519831eae0dd9e3c42'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.712292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2602727b917047519831eae0dd9e3c42'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.713118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2602727b917047519831eae0dd9e3c42'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.732997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1001/1987] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:43 2022] DELETE /identity/v3/users/bd6517b64f02486c90ed1160dbccf795 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:43.735712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:43.743655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:43.744918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-54d1a33a-e6c5-4d53-8461-1cc7bff44730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2602727b917047519831eae0dd9e3c42'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:43.824548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 987/1988] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:43 2022] DELETE /identity/v3/users/2602727b917047519831eae0dd9e3c42 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:43.825645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0d18c-5cec-4247-816f-257923ba1b0b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:43.825927 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0d18c-5cec-4247-816f-257923ba1b0b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:43.826357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0d18c-5cec-4247-816f-257923ba1b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:43.853308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:43.870100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e3c0d18c-5cec-4247-816f-257923ba1b0b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:43.872123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e3c0d18c-5cec-4247-816f-257923ba1b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:43.885078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119181a-7522-4e59-93da-5a6402dd8c73 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:43.963909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 988/1989] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:43.963909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7972-5b01-4d1e-a93d-21b0c152da8c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:43.963909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7972-5b01-4d1e-a93d-21b0c152da8c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:43.963909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7972-5b01-4d1e-a93d-21b0c152da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:43.979771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:43.980378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:43.980653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:43.981000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:43.981915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:43.983722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:43.985028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1a5d7972-5b01-4d1e-a93d-21b0c152da8c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:43.986331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1a5d7972-5b01-4d1e-a93d-21b0c152da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:43.994166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1002/1990] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:43.995343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:43.996611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:44.001342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 989/1991] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:44.001342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d7972-5b01-4d1e-a93d-21b0c152da8c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:44.002647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1a5d7972-5b01-4d1e-a93d-21b0c152da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:44.017810 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d7972-5b01-4d1e-a93d-21b0c152da8c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:44.025633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:44.026564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.026949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.027283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] PATH_INFO: `/v3/projects/db83c617e33e46feade589a21ecc1f98/users/543724fff6a248e1a4839dde6f51976d/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.043344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=db83c617e33e46feade589a21ecc1f98, user_id=543724fff6a248e1a4839dde6f51976d, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:44.045982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:44.063684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 990/1992] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:43 2022] PUT /identity/v3/projects/db83c617e33e46feade589a21ecc1f98/users/543724fff6a248e1a4839dde6f51976d/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:44.064758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:44.066399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:44.083746 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77caa5-bea1-4e1f-9c96-d7771ac634f5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:44.135338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f45c8-7324-4134-ae82-6f85db35d1cd admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:44.139242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55adb5-aacd-40dd-93ae-6a9612bdc310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:44.140007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55adb5-aacd-40dd-93ae-6a9612bdc310 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.140776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55adb5-aacd-40dd-93ae-6a9612bdc310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.140776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55adb5-aacd-40dd-93ae-6a9612bdc310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.145168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec81c-311d-474b-93b1-8289a8dce9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:44.145917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec81c-311d-474b-93b1-8289a8dce9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.146263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec81c-311d-474b-93b1-8289a8dce9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.146605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ec81c-311d-474b-93b1-8289a8dce9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.189371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:44.204657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:44.218267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ec81c-311d-474b-93b1-8289a8dce9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:44.219913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55adb5-aacd-40dd-93ae-6a9612bdc310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:44.220067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ec81c-311d-474b-93b1-8289a8dce9c2 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:44.221347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55adb5-aacd-40dd-93ae-6a9612bdc310 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:44.231834 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1003/1993] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:44.232677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec81c-311d-474b-93b1-8289a8dce9c2 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:44.244263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ec81c-311d-474b-93b1-8289a8dce9c2 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:44.249286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38aa57-708d-4cee-a737-287f7c94ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:44.250133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38aa57-708d-4cee-a737-287f7c94ffd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.250437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38aa57-708d-4cee-a737-287f7c94ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.250698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38aa57-708d-4cee-a737-287f7c94ffd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.251367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38aa57-708d-4cee-a737-287f7c94ffd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:44.252963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38aa57-708d-4cee-a737-287f7c94ffd8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:44.264755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1004/1994] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:44.271397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 991/1995] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:44.271923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38aa57-708d-4cee-a737-287f7c94ffd8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:44.280032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38aa57-708d-4cee-a737-287f7c94ffd8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:44.285908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:44.286681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.286996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.287272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] PATH_INFO: `/v3/projects/db83c617e33e46feade589a21ecc1f98/users/543724fff6a248e1a4839dde6f51976d/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.290183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db83c617e33e46feade589a21ecc1f98, user_id=543724fff6a248e1a4839dde6f51976d, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:44.293344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:44.306986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1005/1996] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:44 2022] PUT /identity/v3/projects/db83c617e33e46feade589a21ecc1f98/users/543724fff6a248e1a4839dde6f51976d/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:44.319072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39694b-229c-4e81-beed-d2b5e4759923 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.319412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39694b-229c-4e81-beed-d2b5e4759923 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.319661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39694b-229c-4e81-beed-d2b5e4759923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.354602 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ad39694b-229c-4e81-beed-d2b5e4759923 None None] MFA Rules not processed for user `543724fff6a248e1a4839dde6f51976d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:44.355882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ad39694b-229c-4e81-beed-d2b5e4759923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:44.439475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 992/1997] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:44.453731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:44.456271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:44.530040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161896f-42a8-4fb5-a921-337220d65bb7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:44.533930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4452d-ee8c-45b1-b828-c714231728a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:44.534530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4452d-ee8c-45b1-b828-c714231728a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.534820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4452d-ee8c-45b1-b828-c714231728a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.535095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4452d-ee8c-45b1-b828-c714231728a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.545704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4452d-ee8c-45b1-b828-c714231728a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:44.546414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4452d-ee8c-45b1-b828-c714231728a7 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:44.558980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1006/1998] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:44.567344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39694b-229c-4e81-beed-d2b5e4759923 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:44.569745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ad39694b-229c-4e81-beed-d2b5e4759923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:44.669612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39694b-229c-4e81-beed-d2b5e4759923 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:44.677542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:44.678954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.679571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.680619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] PATH_INFO: `/v3/projects/19187c64954c4d79aa2b276b0c173fa7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.682959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] RBAC: Authorizing `identity:delete_project(project_id=19187c64954c4d79aa2b276b0c173fa7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:44.685683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:44.710868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4452d-ee8c-45b1-b828-c714231728a7 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:44.722852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4452d-ee8c-45b1-b828-c714231728a7 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:44.728993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751d964-6486-4469-a7a1-3d5913810ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:44.729501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751d964-6486-4469-a7a1-3d5913810ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.729783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751d964-6486-4469-a7a1-3d5913810ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.730054 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751d964-6486-4469-a7a1-3d5913810ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.732132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a751d964-6486-4469-a7a1-3d5913810ff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:44.752871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19187c64954c4d79aa2b276b0c173fa7', 'request_id': 'req-3af481d0-88fa-4b31-b559-7654797559de'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:44.781654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19187c64954c4d79aa2b276b0c173fa7', 'request_id': 'req-3af481d0-88fa-4b31-b559-7654797559de'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:44.808092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:44.829834 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19187c64954c4d79aa2b276b0c173fa7', 'request_id': 'req-3af481d0-88fa-4b31-b559-7654797559de'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:44.854648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] The token cache is being invalidate because project 19187c64954c4d79aa2b276b0c173fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:44.855347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:44.856002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3af481d0-88fa-4b31-b559-7654797559de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:44.858061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 993/1999] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:44 2022] DELETE /identity/v3/projects/19187c64954c4d79aa2b276b0c173fa7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:44.862703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db3c-bc2c-41ac-9df2-60f236931481 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:44.863248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db3c-bc2c-41ac-9df2-60f236931481 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:44.863776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db3c-bc2c-41ac-9df2-60f236931481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:44.872341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751d964-6486-4469-a7a1-3d5913810ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:44.873810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751d964-6486-4469-a7a1-3d5913810ff2 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:44.886879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1007/2000] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:44.928057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4876db3c-bc2c-41ac-9df2-60f236931481 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:44.929292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4876db3c-bc2c-41ac-9df2-60f236931481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:45.082009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2021163-0e2e-4335-9e5d-364687313962 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.082699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2021163-0e2e-4335-9e5d-364687313962 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.084306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2021163-0e2e-4335-9e5d-364687313962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.098938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 994/2001] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:45.146454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876db3c-bc2c-41ac-9df2-60f236931481 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.148113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4876db3c-bc2c-41ac-9df2-60f236931481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:45.172500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d2021163-0e2e-4335-9e5d-364687313962 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:45.175465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d2021163-0e2e-4335-9e5d-364687313962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:45.176561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876db3c-bc2c-41ac-9df2-60f236931481 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:45.192491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:45.192491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.192836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.192836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] PATH_INFO: `/v3/projects/2a80a0a28e09448d8d15e301c6f244a8` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.194036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a80a0a28e09448d8d15e301c6f244a8)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:45.197764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:45.204766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1008/2002] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:45.208487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2021163-0e2e-4335-9e5d-364687313962 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.225107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2021163-0e2e-4335-9e5d-364687313962 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:45.232527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:45.233143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.233420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.233691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.234391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:45.234640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:45.236414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:45.253299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1009/2003] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:01:45.258253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.279011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b257c-32a9-424a-a36e-80167ebbd0a4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:45.296473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a80a0a28e09448d8d15e301c6f244a8', 'request_id': 'req-543084ee-2d29-4eb8-a490-2a9bfcbb114f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.307896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a80a0a28e09448d8d15e301c6f244a8', 'request_id': 'req-543084ee-2d29-4eb8-a490-2a9bfcbb114f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.323217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a80a0a28e09448d8d15e301c6f244a8', 'request_id': 'req-543084ee-2d29-4eb8-a490-2a9bfcbb114f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.359552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] The token cache is being invalidate because project 2a80a0a28e09448d8d15e301c6f244a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:45.360033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.364127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.373828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 995/2004] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:45 2022] DELETE /identity/v3/projects/2a80a0a28e09448d8d15e301c6f244a8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:45.375984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.378417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:45.413602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:45.450441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:45.451205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.451545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.452178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.453175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:45.455498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:45.506681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1010/2005] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:45 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:45.511314 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.517530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:45.528773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543084ee-2d29-4eb8-a490-2a9bfcbb114f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:45.570390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:45.623603 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8e5d-bfa2-4a2a-88a8-f77120c4b5d2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:45.650656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c28078-1c47-4dd0-a102-4e4a890d6766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:45.650656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c28078-1c47-4dd0-a102-4e4a890d6766 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.650656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c28078-1c47-4dd0-a102-4e4a890d6766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.650656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c28078-1c47-4dd0-a102-4e4a890d6766 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.651175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c28078-1c47-4dd0-a102-4e4a890d6766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:45.651175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c28078-1c47-4dd0-a102-4e4a890d6766 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:45.665785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:45.666462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.666726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.667022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] PATH_INFO: `/v3/users/007fd1594e8249fa82fd0f315f7b9530` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.668442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=007fd1594e8249fa82fd0f315f7b9530)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:45.671837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:45.700174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1011/2006] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:45 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:45.702684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c28078-1c47-4dd0-a102-4e4a890d6766 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.717242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c28078-1c47-4dd0-a102-4e4a890d6766 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:45.722587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46849f6-122b-4bfc-ba3a-504df5540780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:45.723437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46849f6-122b-4bfc-ba3a-504df5540780 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.723858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46849f6-122b-4bfc-ba3a-504df5540780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.724371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46849f6-122b-4bfc-ba3a-504df5540780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.725239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46849f6-122b-4bfc-ba3a-504df5540780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:45.728081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46849f6-122b-4bfc-ba3a-504df5540780 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:45.745405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1012/2007] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:45.746841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46849f6-122b-4bfc-ba3a-504df5540780 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.761733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46849f6-122b-4bfc-ba3a-504df5540780 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:45.767426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6522c10-9276-47e0-853a-847c90d8a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:45.768043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522c10-9276-47e0-853a-847c90d8a5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.768318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522c10-9276-47e0-853a-847c90d8a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.768726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522c10-9276-47e0-853a-847c90d8a5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.769521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6522c10-9276-47e0-853a-847c90d8a5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:45.771174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6522c10-9276-47e0-853a-847c90d8a5f4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:45.785906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1013/2008] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:45.791656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6522c10-9276-47e0-853a-847c90d8a5f4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.807817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6522c10-9276-47e0-853a-847c90d8a5f4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:45.808043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007fd1594e8249fa82fd0f315f7b9530'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.816036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:45.816802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.817108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.817370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] PATH_INFO: `/v3/projects/7e79c03668094fb2b7dc64cb6f624711/users/8762eca4b5ad4af1a12c78d5439e3f5c/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.819475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007fd1594e8249fa82fd0f315f7b9530'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.820064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007fd1594e8249fa82fd0f315f7b9530'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.820772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007fd1594e8249fa82fd0f315f7b9530'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.831350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-776d8095-cc51-442b-8e95-fa7e02c15bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007fd1594e8249fa82fd0f315f7b9530'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:45.840656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e79c03668094fb2b7dc64cb6f624711, user_id=8762eca4b5ad4af1a12c78d5439e3f5c, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:45.845560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:45.865462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1014/2009] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:45 2022] PUT /identity/v3/projects/7e79c03668094fb2b7dc64cb6f624711/users/8762eca4b5ad4af1a12c78d5439e3f5c/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:45.870851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:45.872591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:45.877227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 996/2010] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:45 2022] DELETE /identity/v3/users/007fd1594e8249fa82fd0f315f7b9530 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:45.881185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2747a-4e23-4ee0-a130-cd16503b417a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:45.881475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2747a-4e23-4ee0-a130-cd16503b417a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:45.881751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2747a-4e23-4ee0-a130-cd16503b417a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:45.934381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-48d2747a-4e23-4ee0-a130-cd16503b417a None None] MFA Rules not processed for user `8762eca4b5ad4af1a12c78d5439e3f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:45.935645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-48d2747a-4e23-4ee0-a130-cd16503b417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:46.088282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d72a4-7408-46d2-81b7-fbca935de73a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:46.094664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 997/2011] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:46.099031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2747a-4e23-4ee0-a130-cd16503b417a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:46.100915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-48d2747a-4e23-4ee0-a130-cd16503b417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:46.164932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:46.178948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:46.259616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:46.260319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:46.260541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:46.260815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] PATH_INFO: `/v3/projects/4d550da0ce1847a8afc6cd0aca5347cd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:46.264890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d550da0ce1847a8afc6cd0aca5347cd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:46.269487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:46.306809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2747a-4e23-4ee0-a130-cd16503b417a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:46.338378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa745f3-4638-4f46-9f9b-1a922561c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:46.339153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa745f3-4638-4f46-9f9b-1a922561c2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:46.339580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa745f3-4638-4f46-9f9b-1a922561c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:46.339973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa745f3-4638-4f46-9f9b-1a922561c2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:46.340722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa745f3-4638-4f46-9f9b-1a922561c2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:46.343419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa745f3-4638-4f46-9f9b-1a922561c2e4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:46.410251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 998/2012] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:46 2022] POST /identity/v3/projects => generated 385 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:46.412145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa745f3-4638-4f46-9f9b-1a922561c2e4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:46.466498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d550da0ce1847a8afc6cd0aca5347cd', 'request_id': 'req-d2f14d8c-d8bc-4cfb-9286-79ec40095225'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.479114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d550da0ce1847a8afc6cd0aca5347cd', 'request_id': 'req-d2f14d8c-d8bc-4cfb-9286-79ec40095225'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.494267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d550da0ce1847a8afc6cd0aca5347cd', 'request_id': 'req-d2f14d8c-d8bc-4cfb-9286-79ec40095225'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.517025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] The token cache is being invalidate because project 4d550da0ce1847a8afc6cd0aca5347cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:46.517382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.518124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.519895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1015/2013] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:45 2022] DELETE /identity/v3/projects/4d550da0ce1847a8afc6cd0aca5347cd => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:46.523972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:46.525569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:46.535422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa745f3-4638-4f46-9f9b-1a922561c2e4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:46.541532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:46.543140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:46.544463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:46.544889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:46.546345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:46.549360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:46.606977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 999/2014] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:46 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:46.606977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:46.606977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:46.639212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff90a60-2f54-4222-a106-cb4cdeac36fb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:46.652542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b287d1c-7447-49a4-98fa-3512edaa0b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:46.653169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287d1c-7447-49a4-98fa-3512edaa0b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:46.653449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287d1c-7447-49a4-98fa-3512edaa0b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:46.653718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287d1c-7447-49a4-98fa-3512edaa0b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:46.656193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b287d1c-7447-49a4-98fa-3512edaa0b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:46.661407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b287d1c-7447-49a4-98fa-3512edaa0b2f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:46.668157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f14d8c-d8bc-4cfb-9286-79ec40095225 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:46.682168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:46.682845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:46.683126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:46.683428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] PATH_INFO: `/v3/users/57e21d61acf74f2cb60fb4a73a2b69fc` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:46.693041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e21d61acf74f2cb60fb4a73a2b69fc)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:46.693402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1000/2015] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:46.694561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b287d1c-7447-49a4-98fa-3512edaa0b2f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:46.695965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:46.723530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b287d1c-7447-49a4-98fa-3512edaa0b2f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:46.740023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:46.743569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:46.743856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:46.744138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] PATH_INFO: `/v3/projects/647c5e4f162d43da84b6c3c93754bc1f/users/4529eb21d1e14098ab677e5dcf1cbbc8/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:46.790610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] RBAC: Authorizing `identity:create_grant(project_id=647c5e4f162d43da84b6c3c93754bc1f, user_id=4529eb21d1e14098ab677e5dcf1cbbc8, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:46.799814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:46.802775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e21d61acf74f2cb60fb4a73a2b69fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.817899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e21d61acf74f2cb60fb4a73a2b69fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.820850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e21d61acf74f2cb60fb4a73a2b69fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.824778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e21d61acf74f2cb60fb4a73a2b69fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.825769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:46.837598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1001/2016] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:46 2022] PUT /identity/v3/projects/647c5e4f162d43da84b6c3c93754bc1f/users/4529eb21d1e14098ab677e5dcf1cbbc8/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:46.839284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:46.841040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e21d61acf74f2cb60fb4a73a2b69fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:46.844285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:46.886033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1016/2017] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:46 2022] DELETE /identity/v3/users/57e21d61acf74f2cb60fb4a73a2b69fc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:46.886964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:46.890662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:47.059149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490d56-6bc8-47da-9dde-f752c9d5663a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:47.119838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:47.129958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cd2a0-5a0b-4b81-840a-fc09e1ae2de0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:47.146400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5057778-b6e7-4311-9a71-7697ba195ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:47.147255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057778-b6e7-4311-9a71-7697ba195ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.147709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057778-b6e7-4311-9a71-7697ba195ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.148204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057778-b6e7-4311-9a71-7697ba195ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.149593 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5057778-b6e7-4311-9a71-7697ba195ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:47.151368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5057778-b6e7-4311-9a71-7697ba195ff5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:47.178484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1017/2018] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:47.180270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5057778-b6e7-4311-9a71-7697ba195ff5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:47.215401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5057778-b6e7-4311-9a71-7697ba195ff5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:47.229068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047ee8d-f929-4df0-82a0-19a6dd794887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:47.229843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ee8d-f929-4df0-82a0-19a6dd794887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.230123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ee8d-f929-4df0-82a0-19a6dd794887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.230397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ee8d-f929-4df0-82a0-19a6dd794887 admin admin] PATH_INFO: `/v3/projects/647c5e4f162d43da84b6c3c93754bc1f/users/4529eb21d1e14098ab677e5dcf1cbbc8/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.233212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047ee8d-f929-4df0-82a0-19a6dd794887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647c5e4f162d43da84b6c3c93754bc1f, user_id=4529eb21d1e14098ab677e5dcf1cbbc8, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:47.245948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047ee8d-f929-4df0-82a0-19a6dd794887 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:47.247636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:47.249111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.250715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.251129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] PATH_INFO: `/v3/projects/64d3778c9bd64606b90c15fa95d96f27` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.254789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d3778c9bd64606b90c15fa95d96f27)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:47.267565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:47.302842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1018/2019] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:47 2022] PUT /identity/v3/projects/647c5e4f162d43da84b6c3c93754bc1f/users/4529eb21d1e14098ab677e5dcf1cbbc8/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:47.314822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43853-fffb-4b2a-9fcf-ff57d7f8e63c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.315157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43853-fffb-4b2a-9fcf-ff57d7f8e63c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.315375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43853-fffb-4b2a-9fcf-ff57d7f8e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.354364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d3778c9bd64606b90c15fa95d96f27', 'request_id': 'req-911ead82-0fb3-499f-ab2a-cf448d053e13'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.367375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d3778c9bd64606b90c15fa95d96f27', 'request_id': 'req-911ead82-0fb3-499f-ab2a-cf448d053e13'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.380578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-39a43853-fffb-4b2a-9fcf-ff57d7f8e63c None None] MFA Rules not processed for user `4529eb21d1e14098ab677e5dcf1cbbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:47.385796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d3778c9bd64606b90c15fa95d96f27', 'request_id': 'req-911ead82-0fb3-499f-ab2a-cf448d053e13'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.390382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-39a43853-fffb-4b2a-9fcf-ff57d7f8e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:47.416318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] The token cache is being invalidate because project 64d3778c9bd64606b90c15fa95d96f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:47.416734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.418127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-911ead82-0fb3-499f-ab2a-cf448d053e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.420583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1002/2020] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:46 2022] DELETE /identity/v3/projects/64d3778c9bd64606b90c15fa95d96f27 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:47.427197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b224f-2410-429a-a11e-6c1f3fcf76af None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.427652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b224f-2410-429a-a11e-6c1f3fcf76af None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.428632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b224f-2410-429a-a11e-6c1f3fcf76af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.458136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a76b224f-2410-429a-a11e-6c1f3fcf76af None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:47.459560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a76b224f-2410-429a-a11e-6c1f3fcf76af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:47.550126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1019/2021] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:47.566646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a43853-fffb-4b2a-9fcf-ff57d7f8e63c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:47.572050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-39a43853-fffb-4b2a-9fcf-ff57d7f8e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:47.639481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1003/2022] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:47.644943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc1ddf-8a6e-4e7f-be44-4345cf702384 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.645367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc1ddf-8a6e-4e7f-be44-4345cf702384 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.646235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc1ddf-8a6e-4e7f-be44-4345cf702384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.677606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:47.704140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b6cc1ddf-8a6e-4e7f-be44-4345cf702384 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:47.709784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6cc1ddf-8a6e-4e7f-be44-4345cf702384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:47.712246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a43853-fffb-4b2a-9fcf-ff57d7f8e63c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:47.718498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff1a8-387f-4487-b13f-b8b2f470567d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:47.719987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff1a8-387f-4487-b13f-b8b2f470567d service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.720269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff1a8-387f-4487-b13f-b8b2f470567d service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.720537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff1a8-387f-4487-b13f-b8b2f470567d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.725593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1004/2023] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:47.726436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc1ddf-8a6e-4e7f-be44-4345cf702384 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:47.734232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff1a8-387f-4487-b13f-b8b2f470567d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:47.736621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff1a8-387f-4487-b13f-b8b2f470567d service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:47.739130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b6cc1ddf-8a6e-4e7f-be44-4345cf702384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:47.751374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1020/2024] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:47.752875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff1a8-387f-4487-b13f-b8b2f470567d service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:47.766149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff1a8-387f-4487-b13f-b8b2f470567d service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:47.767581 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc1ddf-8a6e-4e7f-be44-4345cf702384 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:47.773053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:47.774354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.774685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.775006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.775503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:47.775841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:47.776149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:47.776770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.777256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.777734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] PATH_INFO: `/v3/projects/ca720bed25b24748be999180b6f786dd` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.778042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:47.779375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca720bed25b24748be999180b6f786dd)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:47.781502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:47.806814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1021/2025] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:47.815853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:47.837454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0950-824d-4a78-905e-2e23b14c5957 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:47.851025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f57af-2d49-4970-aff2-21ec2d397d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:47.851680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f57af-2d49-4970-aff2-21ec2d397d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:47.852084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f57af-2d49-4970-aff2-21ec2d397d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:47.852309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f57af-2d49-4970-aff2-21ec2d397d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:47.853011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f57af-2d49-4970-aff2-21ec2d397d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:47.855453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f57af-2d49-4970-aff2-21ec2d397d39 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:47.870813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:47.895557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1022/2026] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:47 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:47.900228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f57af-2d49-4970-aff2-21ec2d397d39 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:47.906591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca720bed25b24748be999180b6f786dd', 'request_id': 'req-b0c6a7e9-d102-45f6-9b33-860563bce835'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.916309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca720bed25b24748be999180b6f786dd', 'request_id': 'req-b0c6a7e9-d102-45f6-9b33-860563bce835'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.943662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca720bed25b24748be999180b6f786dd', 'request_id': 'req-b0c6a7e9-d102-45f6-9b33-860563bce835'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.981959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] The token cache is being invalidate because project ca720bed25b24748be999180b6f786dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:47.982542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.984593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:47.986467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1005/2027] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:47 2022] DELETE /identity/v3/projects/ca720bed25b24748be999180b6f786dd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:47.991630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:47.993205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.026394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f57af-2d49-4970-aff2-21ec2d397d39 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.034964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576442e1-abf5-4709-918d-0ba07069b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.035687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576442e1-abf5-4709-918d-0ba07069b00b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.040031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576442e1-abf5-4709-918d-0ba07069b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.040417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576442e1-abf5-4709-918d-0ba07069b00b admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.041138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576442e1-abf5-4709-918d-0ba07069b00b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.043437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576442e1-abf5-4709-918d-0ba07069b00b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.083292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1023/2028] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:47 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:48.084574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38255fd-6064-433e-a6b5-98109fb5a268 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.084855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38255fd-6064-433e-a6b5-98109fb5a268 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.085122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38255fd-6064-433e-a6b5-98109fb5a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.130873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e38255fd-6064-433e-a6b5-98109fb5a268 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:48.132909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e38255fd-6064-433e-a6b5-98109fb5a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.144473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6a7e9-d102-45f6-9b33-860563bce835 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.147774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1024/2029] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:48.152230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38255fd-6064-433e-a6b5-98109fb5a268 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.156120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e38255fd-6064-433e-a6b5-98109fb5a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.171466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.172352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38255fd-6064-433e-a6b5-98109fb5a268 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.177337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f3a9e-cd7b-40ad-9f91-749a9fb13ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.177929 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f3a9e-cd7b-40ad-9f91-749a9fb13ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.178206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f3a9e-cd7b-40ad-9f91-749a9fb13ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.178474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f3a9e-cd7b-40ad-9f91-749a9fb13ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.179210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f3a9e-cd7b-40ad-9f91-749a9fb13ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.179382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.180894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.181967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f3a9e-cd7b-40ad-9f91-749a9fb13ffe admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.182424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] PATH_INFO: `/v3/users/8762eca4b5ad4af1a12c78d5439e3f5c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.196047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8762eca4b5ad4af1a12c78d5439e3f5c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.200677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1025/2030] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:48.202134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.202377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176a34-a06d-47a5-90ba-41e20cf31e14 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.202813 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176a34-a06d-47a5-90ba-41e20cf31e14 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.203089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176a34-a06d-47a5-90ba-41e20cf31e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.230810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b1176a34-a06d-47a5-90ba-41e20cf31e14 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:48.233273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b1176a34-a06d-47a5-90ba-41e20cf31e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.248578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1026/2031] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:48.248578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1176a34-a06d-47a5-90ba-41e20cf31e14 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.278205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1176a34-a06d-47a5-90ba-41e20cf31e14 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.307118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8762eca4b5ad4af1a12c78d5439e3f5c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:48.320480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.321107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.321287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.321554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.322261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.324101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.336745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8762eca4b5ad4af1a12c78d5439e3f5c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:48.338620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8762eca4b5ad4af1a12c78d5439e3f5c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:48.339533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8762eca4b5ad4af1a12c78d5439e3f5c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:48.342547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1027/2032] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:48.343965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.347330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.366257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8762eca4b5ad4af1a12c78d5439e3f5c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:48.375621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371bfb5-d23c-45fd-980d-32e93453ab5d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.390625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc2dd8-e139-451c-940a-c1be88d70c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.391309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2dd8-e139-451c-940a-c1be88d70c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.391585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2dd8-e139-451c-940a-c1be88d70c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.391856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc2dd8-e139-451c-940a-c1be88d70c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.392518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc2dd8-e139-451c-940a-c1be88d70c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:48.392864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc2dd8-e139-451c-940a-c1be88d70c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.394418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc2dd8-e139-451c-940a-c1be88d70c63 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.408381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1006/2033] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:47 2022] DELETE /identity/v3/users/8762eca4b5ad4af1a12c78d5439e3f5c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:48.409483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.412991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.427832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1028/2034] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:01:48.429185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452451-ca91-4228-9815-10fcba1b5a1c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.429466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452451-ca91-4228-9815-10fcba1b5a1c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.429768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452451-ca91-4228-9815-10fcba1b5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.484024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0b452451-ca91-4228-9815-10fcba1b5a1c None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:48.489373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0b452451-ca91-4228-9815-10fcba1b5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.528862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:48.573118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c1765-72ab-4ccf-b292-9f8d11f5ec19 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.596020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.597664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.600445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.600855 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] PATH_INFO: `/v3/projects/fa648366cee34a47a4d9c88cdb693021/users/4ca86251019a419a9d31e2578e6e009d/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.603962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:48.630023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa648366cee34a47a4d9c88cdb693021, user_id=4ca86251019a419a9d31e2578e6e009d, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.633163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.634083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1029/2035] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:48.635492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452451-ca91-4228-9815-10fcba1b5a1c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.667935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452451-ca91-4228-9815-10fcba1b5a1c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.670265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1007/2036] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:48 2022] PUT /identity/v3/projects/fa648366cee34a47a4d9c88cdb693021/users/4ca86251019a419a9d31e2578e6e009d/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:48.671266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.673166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.755283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538283d0-0e48-4713-ba85-798e6496b861 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.756718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e962654-6e58-4839-86bf-ffece19d6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.757348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962654-6e58-4839-86bf-ffece19d6bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.758585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962654-6e58-4839-86bf-ffece19d6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.759031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962654-6e58-4839-86bf-ffece19d6bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.759922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e962654-6e58-4839-86bf-ffece19d6bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.760861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3147-428f-4695-8463-bfe177b08b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.761848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e962654-6e58-4839-86bf-ffece19d6bdb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.763765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3147-428f-4695-8463-bfe177b08b2a service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.764271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3147-428f-4695-8463-bfe177b08b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.764761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3147-428f-4695-8463-bfe177b08b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.776465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d3147-428f-4695-8463-bfe177b08b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.778019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d3147-428f-4695-8463-bfe177b08b2a service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.790109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1008/2037] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:48.791299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fbc64-4156-43a1-9516-2303f7d5393e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.791583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fbc64-4156-43a1-9516-2303f7d5393e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.791846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fbc64-4156-43a1-9516-2303f7d5393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.800764 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1030/2038] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:48 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:48.805525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e962654-6e58-4839-86bf-ffece19d6bdb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.835749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4f2fbc64-4156-43a1-9516-2303f7d5393e None None] MFA Rules not processed for user `4ca86251019a419a9d31e2578e6e009d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:48.837049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4f2fbc64-4156-43a1-9516-2303f7d5393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:48.911888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e962654-6e58-4839-86bf-ffece19d6bdb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.921733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61016fe8-3887-4726-be12-d65af380a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.922347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016fe8-3887-4726-be12-d65af380a5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.923130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016fe8-3887-4726-be12-d65af380a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.923408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016fe8-3887-4726-be12-d65af380a5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.924679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61016fe8-3887-4726-be12-d65af380a5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.927424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61016fe8-3887-4726-be12-d65af380a5a2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:48.956332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1009/2039] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:48.958245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1031/2040] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:48 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:48.961201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fbc64-4156-43a1-9516-2303f7d5393e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.963386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61016fe8-3887-4726-be12-d65af380a5a2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:48.977811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61016fe8-3887-4726-be12-d65af380a5a2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:48.984988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903139-246e-46da-8c1b-9fe96fb7c2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:48.985768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903139-246e-46da-8c1b-9fe96fb7c2ec admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:48.986067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903139-246e-46da-8c1b-9fe96fb7c2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:48.986368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903139-246e-46da-8c1b-9fe96fb7c2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:48.987092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f903139-246e-46da-8c1b-9fe96fb7c2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:48.988757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f903139-246e-46da-8c1b-9fe96fb7c2ec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.004005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fbc64-4156-43a1-9516-2303f7d5393e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.006891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1032/2041] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:01:49.008881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903139-246e-46da-8c1b-9fe96fb7c2ec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.012201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bca419-293f-4232-8670-f5db0d210266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.012816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bca419-293f-4232-8670-f5db0d210266 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.013138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bca419-293f-4232-8670-f5db0d210266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.013454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bca419-293f-4232-8670-f5db0d210266 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.014155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bca419-293f-4232-8670-f5db0d210266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.018204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bca419-293f-4232-8670-f5db0d210266 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.021851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903139-246e-46da-8c1b-9fe96fb7c2ec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.029087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70924-ff04-44ee-bf4a-c55395dc4840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.029704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70924-ff04-44ee-bf4a-c55395dc4840 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.029977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70924-ff04-44ee-bf4a-c55395dc4840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.030244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70924-ff04-44ee-bf4a-c55395dc4840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.031407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70924-ff04-44ee-bf4a-c55395dc4840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.033148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70924-ff04-44ee-bf4a-c55395dc4840 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.048248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1033/2042] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:49.052685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70924-ff04-44ee-bf4a-c55395dc4840 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.070010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1010/2043] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:48 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:49.074180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bca419-293f-4232-8670-f5db0d210266 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.094482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70924-ff04-44ee-bf4a-c55395dc4840 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.142061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:49.162863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:49.180774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bca419-293f-4232-8670-f5db0d210266 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.185789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.186471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.186763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.187044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.187686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.189586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.196694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a9bf-3737-4003-b858-2047bf12376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.197327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a9bf-3737-4003-b858-2047bf12376e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.197602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a9bf-3737-4003-b858-2047bf12376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.197874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a9bf-3737-4003-b858-2047bf12376e admin admin] PATH_INFO: `/v3/projects/a468e12ae5ac4ffc8c0134b8ba99f1cb/users/34023f8e08e64d0b93b306064fb7dc9b/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.217375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1011/2044] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:49 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:49.218435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.221563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:49.224558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103a9bf-3737-4003-b858-2047bf12376e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a468e12ae5ac4ffc8c0134b8ba99f1cb, user_id=34023f8e08e64d0b93b306064fb7dc9b, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.227694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103a9bf-3737-4003-b858-2047bf12376e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.234989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a55dd-ed76-4e09-9a97-5aa05ee1c423 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.241424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1034/2045] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:49 2022] PUT /identity/v3/projects/a468e12ae5ac4ffc8c0134b8ba99f1cb/users/34023f8e08e64d0b93b306064fb7dc9b/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:49.242838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a9bf-3737-4003-b858-2047bf12376e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.310895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.311649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.311914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.312204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] PATH_INFO: `/v3/projects/7e79c03668094fb2b7dc64cb6f624711` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.313506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e79c03668094fb2b7dc64cb6f624711)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.315543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.323508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a9bf-3737-4003-b858-2047bf12376e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.329460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe20e-3a1f-470f-a3fc-3435b8c0b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.330018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe20e-3a1f-470f-a3fc-3435b8c0b494 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.330261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe20e-3a1f-470f-a3fc-3435b8c0b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.330530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe20e-3a1f-470f-a3fc-3435b8c0b494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.331198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fe20e-3a1f-470f-a3fc-3435b8c0b494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.332765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fe20e-3a1f-470f-a3fc-3435b8c0b494 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.344024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1035/2046] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:49.348580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd368b8-2e85-4e9d-8745-26358e61e429 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.348866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd368b8-2e85-4e9d-8745-26358e61e429 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.349183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd368b8-2e85-4e9d-8745-26358e61e429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.397730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e79c03668094fb2b7dc64cb6f624711', 'request_id': 'req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.400628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9dd368b8-2e85-4e9d-8745-26358e61e429 None None] MFA Rules not processed for user `34023f8e08e64d0b93b306064fb7dc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:49.402026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9dd368b8-2e85-4e9d-8745-26358e61e429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:49.404318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e79c03668094fb2b7dc64cb6f624711', 'request_id': 'req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.416537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e79c03668094fb2b7dc64cb6f624711', 'request_id': 'req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.432342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] The token cache is being invalidate because project 7e79c03668094fb2b7dc64cb6f624711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:49.432540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.433351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.438428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1012/2047] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:49 2022] DELETE /identity/v3/projects/7e79c03668094fb2b7dc64cb6f624711 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:49.439407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.441319 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:49.487546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1036/2048] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:49.488828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd368b8-2e85-4e9d-8745-26358e61e429 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.491044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9dd368b8-2e85-4e9d-8745-26358e61e429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:49.519916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:49.525688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb9ccf-8b35-4e7c-aab4-66228adf4211 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.531386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.532184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.532500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.533046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.534794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.536642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.556184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1013/2049] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:49.556686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.558789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:49.571475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:49.597570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd368b8-2e85-4e9d-8745-26358e61e429 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.604297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.604945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.605220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.605490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] PATH_INFO: `/v3/users/4529eb21d1e14098ab677e5dcf1cbbc8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.606652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4529eb21d1e14098ab677e5dcf1cbbc8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.608746 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.692022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7580a-c08c-4c36-811c-937eda6e7d8e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.696369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b6c6-b5af-4a2b-ade8-7dee0ef23b11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.697085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b6c6-b5af-4a2b-ade8-7dee0ef23b11 service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.697279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4529eb21d1e14098ab677e5dcf1cbbc8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.697395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b6c6-b5af-4a2b-ade8-7dee0ef23b11 service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.697620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b6c6-b5af-4a2b-ade8-7dee0ef23b11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.709452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b6c6-b5af-4a2b-ade8-7dee0ef23b11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.712083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b6c6-b5af-4a2b-ade8-7dee0ef23b11 service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.712846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4529eb21d1e14098ab677e5dcf1cbbc8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.713943 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4529eb21d1e14098ab677e5dcf1cbbc8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.714790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4529eb21d1e14098ab677e5dcf1cbbc8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.726129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd329e03-ec7c-4e54-8b5a-e5a338bb1bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4529eb21d1e14098ab677e5dcf1cbbc8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:49.727732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1014/2050] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:49.728711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b6c6-b5af-4a2b-ade8-7dee0ef23b11 service glance] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.741955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b6c6-b5af-4a2b-ade8-7dee0ef23b11 service glance] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:49.749395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:49.750072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.750391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.750802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1037/2051] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:49 2022] DELETE /identity/v3/users/4529eb21d1e14098ab677e5dcf1cbbc8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:49.753778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] PATH_INFO: `/v3/projects/9f4ed1939bfc40ceaf5df0bea010747a/users/eb550625997d4391a97f04bfeb61bec7/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.788386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4ed1939bfc40ceaf5df0bea010747a, user_id=eb550625997d4391a97f04bfeb61bec7, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:49.791842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:49.820332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1015/2052] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:49 2022] PUT /identity/v3/projects/9f4ed1939bfc40ceaf5df0bea010747a/users/eb550625997d4391a97f04bfeb61bec7/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:49.832649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d073e8-d092-48b7-8c74-a8b9eec7904a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:49.833018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d073e8-d092-48b7-8c74-a8b9eec7904a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:49.833292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d073e8-d092-48b7-8c74-a8b9eec7904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:49.869099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-28d073e8-d092-48b7-8c74-a8b9eec7904a None None] MFA Rules not processed for user `eb550625997d4391a97f04bfeb61bec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:49.870482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-28d073e8-d092-48b7-8c74-a8b9eec7904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:49.969456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1038/2053] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:49.979888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:49.981960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:50.091024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331342-0112-41eb-9c23-91ca2821b8d5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.100390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631469c-e3b6-4f6b-b48a-06a0ea7199df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.102151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631469c-e3b6-4f6b-b48a-06a0ea7199df admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.103257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631469c-e3b6-4f6b-b48a-06a0ea7199df admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.104052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631469c-e3b6-4f6b-b48a-06a0ea7199df admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.106818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631469c-e3b6-4f6b-b48a-06a0ea7199df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.112010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631469c-e3b6-4f6b-b48a-06a0ea7199df admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.149517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d073e8-d092-48b7-8c74-a8b9eec7904a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.151324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-28d073e8-d092-48b7-8c74-a8b9eec7904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:50.160207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1016/2054] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:49 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:50.162295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631469c-e3b6-4f6b-b48a-06a0ea7199df admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.177715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d073e8-d092-48b7-8c74-a8b9eec7904a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.254378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:50.271699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.273472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.274081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.274919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] PATH_INFO: `/v3/projects/647c5e4f162d43da84b6c3c93754bc1f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.276810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] RBAC: Authorizing `identity:delete_project(project_id=647c5e4f162d43da84b6c3c93754bc1f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.279650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.282324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:50.293768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631469c-e3b6-4f6b-b48a-06a0ea7199df admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.305154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85448520-69d4-46bf-8d9f-545e307c13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.306589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85448520-69d4-46bf-8d9f-545e307c13c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.306890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85448520-69d4-46bf-8d9f-545e307c13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.307190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85448520-69d4-46bf-8d9f-545e307c13c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.308317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85448520-69d4-46bf-8d9f-545e307c13c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.311646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85448520-69d4-46bf-8d9f-545e307c13c9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.355458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1017/2055] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:50 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:50.357041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85448520-69d4-46bf-8d9f-545e307c13c9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.373629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85448520-69d4-46bf-8d9f-545e307c13c9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.374955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647c5e4f162d43da84b6c3c93754bc1f', 'request_id': 'req-e14cd981-5378-4b5f-bb7f-37e1f12623db'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:50.383919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647c5e4f162d43da84b6c3c93754bc1f', 'request_id': 'req-e14cd981-5378-4b5f-bb7f-37e1f12623db'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:50.392938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647c5e4f162d43da84b6c3c93754bc1f', 'request_id': 'req-e14cd981-5378-4b5f-bb7f-37e1f12623db'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:50.432219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] The token cache is being invalidate because project 647c5e4f162d43da84b6c3c93754bc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:50.432535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:50.434256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e14cd981-5378-4b5f-bb7f-37e1f12623db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:50.436615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1039/2056] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:50 2022] DELETE /identity/v3/projects/647c5e4f162d43da84b6c3c93754bc1f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:50.441903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775529b-b467-463f-9b5d-f0d13f706568 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.442204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775529b-b467-463f-9b5d-f0d13f706568 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.442480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775529b-b467-463f-9b5d-f0d13f706568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.469300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a775529b-b467-463f-9b5d-f0d13f706568 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:50.471191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a775529b-b467-463f-9b5d-f0d13f706568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:50.480626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.481261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.483627 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.483960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.485174 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.487127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1040/2057] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:50.493653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.496272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d15e49-b98c-42e9-b5cb-79a27f112b84 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.496829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d15e49-b98c-42e9-b5cb-79a27f112b84 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.497121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d15e49-b98c-42e9-b5cb-79a27f112b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.507332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1018/2058] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:50.512240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.516531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:50.528243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a1d15e49-b98c-42e9-b5cb-79a27f112b84 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:50.529454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a1d15e49-b98c-42e9-b5cb-79a27f112b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:50.552323 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1041/2059] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:50.557916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d15e49-b98c-42e9-b5cb-79a27f112b84 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.560330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc287e-1834-4480-924c-f49bceece09c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.573005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d15e49-b98c-42e9-b5cb-79a27f112b84 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.574374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649d15-4361-46bd-b5f5-f9b9b9d8b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.574737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649d15-4361-46bd-b5f5-f9b9b9d8b8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.575047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649d15-4361-46bd-b5f5-f9b9b9d8b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.575454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649d15-4361-46bd-b5f5-f9b9b9d8b8d7 admin admin] PATH_INFO: `/v3/projects/369e62bfc1504a248b11370bd0f97570/users/30f9f683f1714834a65aa724d00b9f42/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.579784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.580590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.580865 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.581312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.582564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:50.583482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.586844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.595769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65649d15-4361-46bd-b5f5-f9b9b9d8b8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369e62bfc1504a248b11370bd0f97570, user_id=30f9f683f1714834a65aa724d00b9f42, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.602635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65649d15-4361-46bd-b5f5-f9b9b9d8b8d7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.610713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1042/2060] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:01:50.613984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.625325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1019/2061] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:50 2022] PUT /identity/v3/projects/369e62bfc1504a248b11370bd0f97570/users/30f9f683f1714834a65aa724d00b9f42/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:50.626927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e34432-a11a-480f-9e13-49cfaa525579 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.631481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649d15-4361-46bd-b5f5-f9b9b9d8b8d7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.710004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c990fd-32a9-40ef-a7eb-2377b0aa4550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.710704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c990fd-32a9-40ef-a7eb-2377b0aa4550 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.712203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c990fd-32a9-40ef-a7eb-2377b0aa4550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.712318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c990fd-32a9-40ef-a7eb-2377b0aa4550 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.713028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c990fd-32a9-40ef-a7eb-2377b0aa4550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.715165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c990fd-32a9-40ef-a7eb-2377b0aa4550 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.731395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649d15-4361-46bd-b5f5-f9b9b9d8b8d7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.738330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9932e-2812-42d5-a7c2-3826a109e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.739463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9932e-2812-42d5-a7c2-3826a109e380 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.741172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9932e-2812-42d5-a7c2-3826a109e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.741625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9932e-2812-42d5-a7c2-3826a109e380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.742742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9932e-2812-42d5-a7c2-3826a109e380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.744982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9932e-2812-42d5-a7c2-3826a109e380 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.750974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1043/2062] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:50 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:50.756494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c990fd-32a9-40ef-a7eb-2377b0aa4550 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.765541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1020/2063] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:50.766605 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9932e-2812-42d5-a7c2-3826a109e380 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.782554 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9932e-2812-42d5-a7c2-3826a109e380 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.847971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:50.880451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c990fd-32a9-40ef-a7eb-2377b0aa4550 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.887787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4804041-7333-4d90-9037-593cdb6a8842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.888414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804041-7333-4d90-9037-593cdb6a8842 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.888693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804041-7333-4d90-9037-593cdb6a8842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.888964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804041-7333-4d90-9037-593cdb6a8842 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.889598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4804041-7333-4d90-9037-593cdb6a8842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.889739 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:50.892635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4804041-7333-4d90-9037-593cdb6a8842 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.930168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1044/2064] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:50 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:01:50.935693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4804041-7333-4d90-9037-593cdb6a8842 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:50.938695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fab62c-a85e-4469-82b6-c6e97af42899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:50.939508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab62c-a85e-4469-82b6-c6e97af42899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.940465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab62c-a85e-4469-82b6-c6e97af42899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.940465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab62c-a85e-4469-82b6-c6e97af42899 admin admin] PATH_INFO: `/v3/projects/369e62bfc1504a248b11370bd0f97570/users/30f9f683f1714834a65aa724d00b9f42/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:50.942859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fab62c-a85e-4469-82b6-c6e97af42899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369e62bfc1504a248b11370bd0f97570, user_id=30f9f683f1714834a65aa724d00b9f42, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:50.947624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fab62c-a85e-4469-82b6-c6e97af42899 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:50.960219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4804041-7333-4d90-9037-593cdb6a8842 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:50.971157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1021/2065] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:50 2022] PUT /identity/v3/projects/369e62bfc1504a248b11370bd0f97570/users/30f9f683f1714834a65aa724d00b9f42/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:50.986331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95abe-7a25-4efb-aed4-afd3c11cd472 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:50.986647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95abe-7a25-4efb-aed4-afd3c11cd472 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:50.988211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95abe-7a25-4efb-aed4-afd3c11cd472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:51.041416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-99c95abe-7a25-4efb-aed4-afd3c11cd472 None None] MFA Rules not processed for user `30f9f683f1714834a65aa724d00b9f42`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:51.042975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-99c95abe-7a25-4efb-aed4-afd3c11cd472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:51.050237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2699-b6c9-4f48-9837-9ec0486b7a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:51.050969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2699-b6c9-4f48-9837-9ec0486b7a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:51.051246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2699-b6c9-4f48-9837-9ec0486b7a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:51.051576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2699-b6c9-4f48-9837-9ec0486b7a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:51.052447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2699-b6c9-4f48-9837-9ec0486b7a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:51.054278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2699-b6c9-4f48-9837-9ec0486b7a93 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:51.069539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1045/2066] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:01:51.076242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2699-b6c9-4f48-9837-9ec0486b7a93 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:51.090102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2699-b6c9-4f48-9837-9ec0486b7a93 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:51.095926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f13b7-5518-4f70-b61d-80a3bc1c1a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:51.096628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f13b7-5518-4f70-b61d-80a3bc1c1a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:51.097066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f13b7-5518-4f70-b61d-80a3bc1c1a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:51.097368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f13b7-5518-4f70-b61d-80a3bc1c1a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:51.098376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f13b7-5518-4f70-b61d-80a3bc1c1a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:51.100399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f13b7-5518-4f70-b61d-80a3bc1c1a6c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:51.123684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1046/2067] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:51.130907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f13b7-5518-4f70-b61d-80a3bc1c1a6c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:51.144522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f13b7-5518-4f70-b61d-80a3bc1c1a6c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:51.152014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa848c8-553f-4d0c-b817-516a3131effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:51.152916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa848c8-553f-4d0c-b817-516a3131effe admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:51.153252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa848c8-553f-4d0c-b817-516a3131effe admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:51.153584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa848c8-553f-4d0c-b817-516a3131effe admin admin] PATH_INFO: `/v3/projects/9cb9f7fabbd24bf48b02b8ac2dbfb1c5/users/cb9e90c52ea448d7b6200638f468ddb4/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:51.159917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1022/2068] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:51.176236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c95abe-7a25-4efb-aed4-afd3c11cd472 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:51.178945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-99c95abe-7a25-4efb-aed4-afd3c11cd472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:51.196758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa848c8-553f-4d0c-b817-516a3131effe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb9f7fabbd24bf48b02b8ac2dbfb1c5, user_id=cb9e90c52ea448d7b6200638f468ddb4, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:51.198058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa848c8-553f-4d0c-b817-516a3131effe admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:51.215433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1047/2069] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:51 2022] PUT /identity/v3/projects/9cb9f7fabbd24bf48b02b8ac2dbfb1c5/users/cb9e90c52ea448d7b6200638f468ddb4/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:51.230563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50562b-230c-4283-a082-fcb242d107dc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:51.231333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50562b-230c-4283-a082-fcb242d107dc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:51.231853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50562b-230c-4283-a082-fcb242d107dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:51.267446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0d50562b-230c-4283-a082-fcb242d107dc None None] MFA Rules not processed for user `cb9e90c52ea448d7b6200638f468ddb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:51.268775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0d50562b-230c-4283-a082-fcb242d107dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:51.269997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c95abe-7a25-4efb-aed4-afd3c11cd472 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:51.353495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1048/2070] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:51.356968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:51.357667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:51.357943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:51.358306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:51.360237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:51.360806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50562b-230c-4283-a082-fcb242d107dc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:51.362700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0d50562b-230c-4283-a082-fcb242d107dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:51.377481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50562b-230c-4283-a082-fcb242d107dc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:51.382408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:51.383965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:51.384291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:51.384632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:51.394729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:51.397889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:51.400099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:51.409818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1049/2071] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:51.438463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:51.439981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:51.451387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1023/2072] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:53.020889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:53.022376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:53.056262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:53.059723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:53.066588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92b8ef-4a7d-487c-9f12-8d54b713da54 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:53.071918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef16de-82ac-4c0b-abf3-fd4cd1209049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:53.072574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef16de-82ac-4c0b-abf3-fd4cd1209049 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:53.072806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef16de-82ac-4c0b-abf3-fd4cd1209049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:53.073072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef16de-82ac-4c0b-abf3-fd4cd1209049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:53.074869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-32ef16de-82ac-4c0b-abf3-fd4cd1209049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:53.115799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3605a-1ccf-4a20-8aad-3947d464a8ef service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:53.121688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:53.122342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:53.122626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:53.122931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] PATH_INFO: `/v3/users/9daea77e23e749a0b6cd360b6b0adcc7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:53.124103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9daea77e23e749a0b6cd360b6b0adcc7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:53.126013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:53.142350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef16de-82ac-4c0b-abf3-fd4cd1209049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:53.143825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef16de-82ac-4c0b-abf3-fd4cd1209049 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:53.153462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1024/2073] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:53.187140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9daea77e23e749a0b6cd360b6b0adcc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.197650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9daea77e23e749a0b6cd360b6b0adcc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.198453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9daea77e23e749a0b6cd360b6b0adcc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.199084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9daea77e23e749a0b6cd360b6b0adcc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.207003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9daea77e23e749a0b6cd360b6b0adcc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.231487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1050/2074] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:53 2022] DELETE /identity/v3/users/9daea77e23e749a0b6cd360b6b0adcc7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:53.235915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12136c-005c-4f1f-9e92-c568ec5e0364 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:53.236200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12136c-005c-4f1f-9e92-c568ec5e0364 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:53.236984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12136c-005c-4f1f-9e92-c568ec5e0364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:53.260973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4f12136c-005c-4f1f-9e92-c568ec5e0364 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:53.262334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4f12136c-005c-4f1f-9e92-c568ec5e0364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:53.341860 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1025/2075] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:53.353109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:53.354731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:53.442790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa5ebe-73d8-4135-9b6a-c697989cdc00 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:53.447237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:53.448454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:53.448454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:53.448686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:53.459315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:53.462916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:53.474222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1051/2076] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:53.771307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12136c-005c-4f1f-9e92-c568ec5e0364 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:53.779406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4f12136c-005c-4f1f-9e92-c568ec5e0364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:53.793662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12136c-005c-4f1f-9e92-c568ec5e0364 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:53.803061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:53.808153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:53.808361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:53.808461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:53.808723 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] PATH_INFO: `/v3/users/9b776d85a5a84e899d28fd6fe28b7d06` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:53.809839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:53.810296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b776d85a5a84e899d28fd6fe28b7d06)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:53.812298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:53.886388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:53.893574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b776d85a5a84e899d28fd6fe28b7d06'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.903998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b776d85a5a84e899d28fd6fe28b7d06'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.904235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd072589-aa39-4716-bb85-8d9125fb507c service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:53.905103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b776d85a5a84e899d28fd6fe28b7d06'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.906302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b776d85a5a84e899d28fd6fe28b7d06'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.908502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2427e-0d1e-48aa-989d-35b8afa93e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:53.908794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2427e-0d1e-48aa-989d-35b8afa93e69 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:53.909073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2427e-0d1e-48aa-989d-35b8afa93e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:53.909344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2427e-0d1e-48aa-989d-35b8afa93e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:53.911183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-40f2427e-0d1e-48aa-989d-35b8afa93e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:53.915127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:53.919612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b776d85a5a84e899d28fd6fe28b7d06'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:53.967775 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1026/2077] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:53 2022] DELETE /identity/v3/users/9b776d85a5a84e899d28fd6fe28b7d06 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:53.969334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:53.974965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:54.008868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2427e-0d1e-48aa-989d-35b8afa93e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.010420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2427e-0d1e-48aa-989d-35b8afa93e69 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.022082 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1052/2078] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:54.028295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0deec-c6d0-48ab-ac4c-0e82055c87d6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.028776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0deec-c6d0-48ab-ac4c-0e82055c87d6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.029084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0deec-c6d0-48ab-ac4c-0e82055c87d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.057894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-42a0deec-c6d0-48ab-ac4c-0e82055c87d6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:54.060527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42a0deec-c6d0-48ab-ac4c-0e82055c87d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:54.073182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833de07-c460-417d-95cc-ad3adb99e7bc admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:54.074193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1053/2079] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:54.080893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:54.081752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.082032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.082304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] PATH_INFO: `/v3/projects/cd6a8e4991c5438099bfe6e2cc308a93` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.083504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6a8e4991c5438099bfe6e2cc308a93)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.085436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.110375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0deec-c6d0-48ab-ac4c-0e82055c87d6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:54.110375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42a0deec-c6d0-48ab-ac4c-0e82055c87d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:54.155051 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6a8e4991c5438099bfe6e2cc308a93', 'request_id': 'req-06ac0244-d24f-4cd0-818a-765e686550ce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:54.187146 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6a8e4991c5438099bfe6e2cc308a93', 'request_id': 'req-06ac0244-d24f-4cd0-818a-765e686550ce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:54.203322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6a8e4991c5438099bfe6e2cc308a93', 'request_id': 'req-06ac0244-d24f-4cd0-818a-765e686550ce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:54.216275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0deec-c6d0-48ab-ac4c-0e82055c87d6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:54.218696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] The token cache is being invalidate because project cd6a8e4991c5438099bfe6e2cc308a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:54.219146 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:54.220416 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06ac0244-d24f-4cd0-818a-765e686550ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:54.222159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1027/2080] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:53 2022] DELETE /identity/v3/projects/cd6a8e4991c5438099bfe6e2cc308a93 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:54.228484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baabf86-ee5c-4cd6-a375-d1d0d457cc1f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.228772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baabf86-ee5c-4cd6-a375-d1d0d457cc1f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.229044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baabf86-ee5c-4cd6-a375-d1d0d457cc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.264870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3baabf86-ee5c-4cd6-a375-d1d0d457cc1f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:54.266927 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3baabf86-ee5c-4cd6-a375-d1d0d457cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:54.301900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:54.302515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.302973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.303381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.305758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:54.341354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1028/2081] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:54.350813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a07c-175a-42f7-abf8-ec656b575725 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.351162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a07c-175a-42f7-abf8-ec656b575725 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.351397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a07c-175a-42f7-abf8-ec656b575725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.368929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:54.380948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:54.381111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8548a07c-175a-42f7-abf8-ec656b575725 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:54.382576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8548a07c-175a-42f7-abf8-ec656b575725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:54.397557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1029/2082] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:54.401977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a07c-175a-42f7-abf8-ec656b575725 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:54.408472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.409997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.411822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a07c-175a-42f7-abf8-ec656b575725 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:54.417615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:54.417615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.417867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.418201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.419023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:54.419329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.421025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.421331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1054/2083] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:54.435103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1030/2084] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:01:54.441006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:54.456323 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31d70-2143-4ba0-a51e-df6c70deff4e service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:54.462296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e614988-9b3d-4ee2-a6bc-b578523cd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:54.465855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614988-9b3d-4ee2-a6bc-b578523cd4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.466273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614988-9b3d-4ee2-a6bc-b578523cd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.466689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614988-9b3d-4ee2-a6bc-b578523cd4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.468320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e614988-9b3d-4ee2-a6bc-b578523cd4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.469562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e614988-9b3d-4ee2-a6bc-b578523cd4c4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.517015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1055/2085] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:54 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:54.521453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:54.544342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40f05-9765-4a0b-84b1-25da5d2d475f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:54.634647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e83e42-9b83-4e0c-b2c1-1158e0c375d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:54.635538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e83e42-9b83-4e0c-b2c1-1158e0c375d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.635818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e83e42-9b83-4e0c-b2c1-1158e0c375d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.636154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e83e42-9b83-4e0c-b2c1-1158e0c375d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.636871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e83e42-9b83-4e0c-b2c1-1158e0c375d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.639157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e83e42-9b83-4e0c-b2c1-1158e0c375d6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.686147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1031/2086] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:54 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:54.688091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e614988-9b3d-4ee2-a6bc-b578523cd4c4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:54.702977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e614988-9b3d-4ee2-a6bc-b578523cd4c4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:54.709311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbb7d2-05f2-451a-ba51-e8ca97c45618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:54.709921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbb7d2-05f2-451a-ba51-e8ca97c45618 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.710200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbb7d2-05f2-451a-ba51-e8ca97c45618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.710474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbb7d2-05f2-451a-ba51-e8ca97c45618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.711222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbb7d2-05f2-451a-ba51-e8ca97c45618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.712813 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbb7d2-05f2-451a-ba51-e8ca97c45618 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.727088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1056/2087] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:54.732136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e83e42-9b83-4e0c-b2c1-1158e0c375d6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:54.756786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e83e42-9b83-4e0c-b2c1-1158e0c375d6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:54.774866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f46a-0575-4cfe-8e68-24ec7a5f3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:54.775901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f46a-0575-4cfe-8e68-24ec7a5f3cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.776419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f46a-0575-4cfe-8e68-24ec7a5f3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.776903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f46a-0575-4cfe-8e68-24ec7a5f3cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.778527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1f46a-0575-4cfe-8e68-24ec7a5f3cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.780574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1f46a-0575-4cfe-8e68-24ec7a5f3cd8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.798287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1032/2088] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:54.802255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbb7d2-05f2-451a-ba51-e8ca97c45618 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:54.816799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbb7d2-05f2-451a-ba51-e8ca97c45618 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:54.825471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:54.826322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.826797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.827238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] PATH_INFO: `/v3/projects/6cc8bf70b6354bfc8ca06ef29270c0a1/users/89e9adac7ad241ee9081ab600342af9b/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.844499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc8bf70b6354bfc8ca06ef29270c0a1, user_id=89e9adac7ad241ee9081ab600342af9b, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:54.847312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:54.865981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1057/2089] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:54 2022] PUT /identity/v3/projects/6cc8bf70b6354bfc8ca06ef29270c0a1/users/89e9adac7ad241ee9081ab600342af9b/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:01:54.871429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365de77-5894-4352-864c-8b04dca0b8c0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:54.871786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365de77-5894-4352-864c-8b04dca0b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:54.872128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365de77-5894-4352-864c-8b04dca0b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:54.900049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d365de77-5894-4352-864c-8b04dca0b8c0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:54.901310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d365de77-5894-4352-864c-8b04dca0b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:55.005048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1033/2090] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:55.017024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:55.019556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:55.087332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52547f-c1be-423f-8656-b960de46924a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:55.092572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26216f08-ebef-476f-ad74-eb878fbd4b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:55.093195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26216f08-ebef-476f-ad74-eb878fbd4b83 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:55.093470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26216f08-ebef-476f-ad74-eb878fbd4b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:55.093743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26216f08-ebef-476f-ad74-eb878fbd4b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:55.103378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26216f08-ebef-476f-ad74-eb878fbd4b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:55.104805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26216f08-ebef-476f-ad74-eb878fbd4b83 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:55.115025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1058/2091] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:01:55.543231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365de77-5894-4352-864c-8b04dca0b8c0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:55.547580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d365de77-5894-4352-864c-8b04dca0b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:55.576393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365de77-5894-4352-864c-8b04dca0b8c0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:55.598612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:55.602386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:55.602849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:55.603134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] PATH_INFO: `/v3/projects/c166ed4284a64bbebfc1c1f853a89918` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:55.615725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c166ed4284a64bbebfc1c1f853a89918)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:55.618668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:55.724721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c166ed4284a64bbebfc1c1f853a89918', 'request_id': 'req-a5938b43-cfe4-430f-8d80-693cbf8f6d26'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:55.733802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c166ed4284a64bbebfc1c1f853a89918', 'request_id': 'req-a5938b43-cfe4-430f-8d80-693cbf8f6d26'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:55.736382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:55.745155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c166ed4284a64bbebfc1c1f853a89918', 'request_id': 'req-a5938b43-cfe4-430f-8d80-693cbf8f6d26'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:55.763179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] The token cache is being invalidate because project c166ed4284a64bbebfc1c1f853a89918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:55.763553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:55.764413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:55.767745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1034/2092] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:55 2022] DELETE /identity/v3/projects/c166ed4284a64bbebfc1c1f853a89918 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:55.772046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26216f08-ebef-476f-ad74-eb878fbd4b83 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:55.787447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26216f08-ebef-476f-ad74-eb878fbd4b83 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:55.889642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:55.891123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:55.891533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:55.891956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] PATH_INFO: `/v3/users/543724fff6a248e1a4839dde6f51976d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:55.893413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=543724fff6a248e1a4839dde6f51976d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:55.896271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:55.971291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:55.995235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543724fff6a248e1a4839dde6f51976d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.011982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543724fff6a248e1a4839dde6f51976d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.014295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543724fff6a248e1a4839dde6f51976d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.015579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543724fff6a248e1a4839dde6f51976d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.030592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9f3590be-d622-46b0-8154-4f31b0963d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543724fff6a248e1a4839dde6f51976d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.070996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1059/2093] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:55 2022] DELETE /identity/v3/users/543724fff6a248e1a4839dde6f51976d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:56.517605 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:56.519679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:56.548232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5938b43-cfe4-430f-8d80-693cbf8f6d26 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:56.702524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:56.703200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:56.703478 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:56.703750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] PATH_INFO: `/v3/projects/db83c617e33e46feade589a21ecc1f98` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:56.705824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db83c617e33e46feade589a21ecc1f98)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:56.709841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:56.835244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db83c617e33e46feade589a21ecc1f98', 'request_id': 'req-0baf8753-dda9-4c51-b4b8-d12395b2d666'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.855020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db83c617e33e46feade589a21ecc1f98', 'request_id': 'req-0baf8753-dda9-4c51-b4b8-d12395b2d666'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.864358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db83c617e33e46feade589a21ecc1f98', 'request_id': 'req-0baf8753-dda9-4c51-b4b8-d12395b2d666'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.897761 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] The token cache is being invalidate because project db83c617e33e46feade589a21ecc1f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:56.898910 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.900358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0baf8753-dda9-4c51-b4b8-d12395b2d666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:56.902738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1035/2094] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:56 2022] DELETE /identity/v3/projects/db83c617e33e46feade589a21ecc1f98 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:56.907876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0202b9-9a1d-41e2-9c17-fc1b9e1c023d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:56.908391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0202b9-9a1d-41e2-9c17-fc1b9e1c023d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:56.908469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0202b9-9a1d-41e2-9c17-fc1b9e1c023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:56.936277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8c0202b9-9a1d-41e2-9c17-fc1b9e1c023d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:56.937919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8c0202b9-9a1d-41e2-9c17-fc1b9e1c023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:57.062171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1060/2095] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:57.069817 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e2ff-3041-4ce2-9663-84d5a83cbc40 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.070660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e2ff-3041-4ce2-9663-84d5a83cbc40 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.071100 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e2ff-3041-4ce2-9663-84d5a83cbc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.119798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f5a1e2ff-3041-4ce2-9663-84d5a83cbc40 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:57.121333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f5a1e2ff-3041-4ce2-9663-84d5a83cbc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:57.149264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1036/2096] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:57.154889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0202b9-9a1d-41e2-9c17-fc1b9e1c023d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:57.177348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0202b9-9a1d-41e2-9c17-fc1b9e1c023d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:57.187318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:57.188091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.188461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.189040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.196574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:57.212367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:57.214654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:57.239996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1e2ff-3041-4ce2-9663-84d5a83cbc40 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:57.244573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f5a1e2ff-3041-4ce2-9663-84d5a83cbc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:57.260007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1061/2097] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:01:57.265810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:57.302239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1e2ff-3041-4ce2-9663-84d5a83cbc40 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:57.323108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de395f-13fe-4538-ae03-96079fcb898e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:57.325744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:57.329341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.330090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.330370 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] PATH_INFO: `/v3/users/cb9e90c52ea448d7b6200638f468ddb4` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.334780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9e90c52ea448d7b6200638f468ddb4)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:57.341686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:57.345501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea932036-b4d3-427f-a3eb-e2adef31ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:57.346137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea932036-b4d3-427f-a3eb-e2adef31ab16 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.346415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea932036-b4d3-427f-a3eb-e2adef31ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.346835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea932036-b4d3-427f-a3eb-e2adef31ab16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.353147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea932036-b4d3-427f-a3eb-e2adef31ab16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:57.359283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea932036-b4d3-427f-a3eb-e2adef31ab16 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:57.424946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1062/2098] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:57 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:57.426739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea932036-b4d3-427f-a3eb-e2adef31ab16 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:57.446569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9e90c52ea448d7b6200638f468ddb4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:57.487476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9e90c52ea448d7b6200638f468ddb4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:57.489221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9e90c52ea448d7b6200638f468ddb4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:57.490975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9e90c52ea448d7b6200638f468ddb4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:57.506313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-33d6d8db-9f96-4ec6-aace-d1522ff08c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9e90c52ea448d7b6200638f468ddb4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:57.516373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:57.533747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea932036-b4d3-427f-a3eb-e2adef31ab16 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:57.545520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:57.546129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.546405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.546780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.548156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:57.551954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:57.557066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1037/2099] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:57 2022] DELETE /identity/v3/users/cb9e90c52ea448d7b6200638f468ddb4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:57.561177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a731d5-6470-4819-a1fa-39af568f2e4e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.561461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a731d5-6470-4819-a1fa-39af568f2e4e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.561875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a731d5-6470-4819-a1fa-39af568f2e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.591036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-09a731d5-6470-4819-a1fa-39af568f2e4e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:57.592727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-09a731d5-6470-4819-a1fa-39af568f2e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:57.594724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1063/2100] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:57 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:57.599536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:57.605412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:57.630532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe7c9-e385-4910-9a56-36cd6720e7da admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:57.645143 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:57.701731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1038/2101] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:57.708775 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a731d5-6470-4819-a1fa-39af568f2e4e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:57.719259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-09a731d5-6470-4819-a1fa-39af568f2e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:57.763185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1948d-7a53-4103-bfb2-ab2815d98991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:57.764027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1948d-7a53-4103-bfb2-ab2815d98991 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.764429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1948d-7a53-4103-bfb2-ab2815d98991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.764839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1948d-7a53-4103-bfb2-ab2815d98991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.765736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1948d-7a53-4103-bfb2-ab2815d98991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:57.767776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1948d-7a53-4103-bfb2-ab2815d98991 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:57.780619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1064/2102] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:01:57.784790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1948d-7a53-4103-bfb2-ab2815d98991 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:57.802509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1948d-7a53-4103-bfb2-ab2815d98991 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:57.808781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8fb7b-8792-41de-8b61-44005ee750ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:57.809399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8fb7b-8792-41de-8b61-44005ee750ac admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.809677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8fb7b-8792-41de-8b61-44005ee750ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.809947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8fb7b-8792-41de-8b61-44005ee750ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.810595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8fb7b-8792-41de-8b61-44005ee750ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:57.812486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8fb7b-8792-41de-8b61-44005ee750ac admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:57.823570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a731d5-6470-4819-a1fa-39af568f2e4e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:57.830801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d9984-b5a1-44f5-b2c6-9ce9ccd1aa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:57.830992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1065/2103] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:01:57.831078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d9984-b5a1-44f5-b2c6-9ce9ccd1aa0b service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.831078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d9984-b5a1-44f5-b2c6-9ce9ccd1aa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.831078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d9984-b5a1-44f5-b2c6-9ce9ccd1aa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.840370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8fb7b-8792-41de-8b61-44005ee750ac admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:57.850440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d9984-b5a1-44f5-b2c6-9ce9ccd1aa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:57.852572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d9984-b5a1-44f5-b2c6-9ce9ccd1aa0b service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:57.865412 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1039/2104] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:57.868402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8fb7b-8792-41de-8b61-44005ee750ac admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:57.879961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e7deb-111c-40c1-a9c0-74fd9cea9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:57.881200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7deb-111c-40c1-a9c0-74fd9cea9d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.881369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7deb-111c-40c1-a9c0-74fd9cea9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.881785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7deb-111c-40c1-a9c0-74fd9cea9d05 admin admin] PATH_INFO: `/v3/projects/1a0816ee141f4bf1b3d10ed6c5507558/users/720c0d05f7c84582a78f0922231b8593/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:57.907573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e7deb-111c-40c1-a9c0-74fd9cea9d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0816ee141f4bf1b3d10ed6c5507558, user_id=720c0d05f7c84582a78f0922231b8593, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:57.910658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e7deb-111c-40c1-a9c0-74fd9cea9d05 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:57.954412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1066/2105] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:57 2022] PUT /identity/v3/projects/1a0816ee141f4bf1b3d10ed6c5507558/users/720c0d05f7c84582a78f0922231b8593/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:57.956491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094398-7638-4ccf-809a-f06fd511ce71 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:57.956832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094398-7638-4ccf-809a-f06fd511ce71 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:57.957140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094398-7638-4ccf-809a-f06fd511ce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:58.040159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ca094398-7638-4ccf-809a-f06fd511ce71 None None] MFA Rules not processed for user `720c0d05f7c84582a78f0922231b8593`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:58.044703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ca094398-7638-4ccf-809a-f06fd511ce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:58.216064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1040/2106] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:58.223040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e7deb-111c-40c1-a9c0-74fd9cea9d05 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:58.360021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e7deb-111c-40c1-a9c0-74fd9cea9d05 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:58.365177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:58.366133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:58.366538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:58.367016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:58.368182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:58.370249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:58.407884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1067/2107] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:58 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:58.411832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca094398-7638-4ccf-809a-f06fd511ce71 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:58.425226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca094398-7638-4ccf-809a-f06fd511ce71 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:58.438928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:58.542163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6f507-f405-452c-8d87-e2a3c48877f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:58.542466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f507-f405-452c-8d87-e2a3c48877f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:58.543076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f507-f405-452c-8d87-e2a3c48877f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:58.543314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6f507-f405-452c-8d87-e2a3c48877f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:58.543516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:58.543999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6f507-f405-452c-8d87-e2a3c48877f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:58.545455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:58.548394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6f507-f405-452c-8d87-e2a3c48877f2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:58.565345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381ef4-d8ea-4286-a020-875bc6dc543a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:58.574669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:58.575860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:58.575860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:58.576272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] PATH_INFO: `/v3/users/4ca86251019a419a9d31e2578e6e009d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:58.577976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca86251019a419a9d31e2578e6e009d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:58.580229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:58.597266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1041/2108] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:58 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:58.600976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6f507-f405-452c-8d87-e2a3c48877f2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:58.621755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6f507-f405-452c-8d87-e2a3c48877f2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:58.627560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0e2d5-a6a5-400b-9f5e-371a51a22a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:58.628365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e2d5-a6a5-400b-9f5e-371a51a22a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:58.628652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e2d5-a6a5-400b-9f5e-371a51a22a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:58.628922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e2d5-a6a5-400b-9f5e-371a51a22a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:58.629599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0e2d5-a6a5-400b-9f5e-371a51a22a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:58.631243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0e2d5-a6a5-400b-9f5e-371a51a22a6e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:58.657131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1042/2109] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:58.658300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0e2d5-a6a5-400b-9f5e-371a51a22a6e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:58.681069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0e2d5-a6a5-400b-9f5e-371a51a22a6e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:58.686859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:58.687057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca86251019a419a9d31e2578e6e009d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:58.687586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:58.687869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:58.688143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] PATH_INFO: `/v3/projects/da8fb1a590794896b2dd85894260a0c7/users/70819fb4b4f548b48670b7c0cd2b1f01/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:58.688917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:58.700651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca86251019a419a9d31e2578e6e009d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:58.703576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca86251019a419a9d31e2578e6e009d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:58.704276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca86251019a419a9d31e2578e6e009d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:58.713682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-308b8131-57d5-4bf2-9f58-b5a43f8db94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca86251019a419a9d31e2578e6e009d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:58.715649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8fb1a590794896b2dd85894260a0c7, user_id=70819fb4b4f548b48670b7c0cd2b1f01, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:58.719701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:58.742999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1043/2110] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:58 2022] PUT /identity/v3/projects/da8fb1a590794896b2dd85894260a0c7/users/70819fb4b4f548b48670b7c0cd2b1f01/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:58.746889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:58.750046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:58.757505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1068/2111] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:01:58 2022] DELETE /identity/v3/users/4ca86251019a419a9d31e2578e6e009d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:58.760450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569bed-c861-4a93-b676-664686214766 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:58.760743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569bed-c861-4a93-b676-664686214766 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:58.761020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569bed-c861-4a93-b676-664686214766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:58.784643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bd569bed-c861-4a93-b676-664686214766 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:58.786922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bd569bed-c861-4a93-b676-664686214766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:58.853246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f212b-eb06-4302-baae-1a47494c9fb4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:58.863932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1069/2112] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:58.879760 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569bed-c861-4a93-b676-664686214766 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:58.881891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bd569bed-c861-4a93-b676-664686214766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:58.945192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:58.945810 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:58.946234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:58.946514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:58.947191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:58.949419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:58.976144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1044/2113] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:01:58.977956 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:58.981716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:58.997570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569bed-c861-4a93-b676-664686214766 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:59.002961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cc774-209d-4edc-89d5-4ea2a7d4007c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:59.003632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3bfd6-b040-4d56-ba40-2fd2a92e5ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:59.004612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3bfd6-b040-4d56-ba40-2fd2a92e5ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.004903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3bfd6-b040-4d56-ba40-2fd2a92e5ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.005340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3bfd6-b040-4d56-ba40-2fd2a92e5ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.009400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:59.010310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.010693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.011088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] PATH_INFO: `/v3/projects/9cb9f7fabbd24bf48b02b8ac2dbfb1c5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.012348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb9f7fabbd24bf48b02b8ac2dbfb1c5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:59.016536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:59.018034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3bfd6-b040-4d56-ba40-2fd2a92e5ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:59.020085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3bfd6-b040-4d56-ba40-2fd2a92e5ec5 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:59.036129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:59.040394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1070/2114] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:59.041525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3bfd6-b040-4d56-ba40-2fd2a92e5ec5 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:59.055060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3bfd6-b040-4d56-ba40-2fd2a92e5ec5 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:59.063652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2daa1-abe6-4a90-83be-1d4b0e703d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:59.064557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2daa1-abe6-4a90-83be-1d4b0e703d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.064907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2daa1-abe6-4a90-83be-1d4b0e703d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.065378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2daa1-abe6-4a90-83be-1d4b0e703d5e admin admin] PATH_INFO: `/v3/projects/da8fb1a590794896b2dd85894260a0c7/users/70819fb4b4f548b48670b7c0cd2b1f01/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.067805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2daa1-abe6-4a90-83be-1d4b0e703d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8fb1a590794896b2dd85894260a0c7, user_id=70819fb4b4f548b48670b7c0cd2b1f01, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:59.071875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2daa1-abe6-4a90-83be-1d4b0e703d5e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:59.086225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1071/2115] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:01:59 2022] PUT /identity/v3/projects/da8fb1a590794896b2dd85894260a0c7/users/70819fb4b4f548b48670b7c0cd2b1f01/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:59.097867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8426a5-6f41-4895-a7d4-d35e2e182e14 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.100139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8426a5-6f41-4895-a7d4-d35e2e182e14 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.101166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8426a5-6f41-4895-a7d4-d35e2e182e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.106359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb9f7fabbd24bf48b02b8ac2dbfb1c5', 'request_id': 'req-c0788e4e-3489-425f-946e-afc3eeccdee8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.130367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb9f7fabbd24bf48b02b8ac2dbfb1c5', 'request_id': 'req-c0788e4e-3489-425f-946e-afc3eeccdee8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.143340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb9f7fabbd24bf48b02b8ac2dbfb1c5', 'request_id': 'req-c0788e4e-3489-425f-946e-afc3eeccdee8'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.176376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] The token cache is being invalidate because project 9cb9f7fabbd24bf48b02b8ac2dbfb1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:59.176660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.178145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ff8426a5-6f41-4895-a7d4-d35e2e182e14 None None] MFA Rules not processed for user `70819fb4b4f548b48670b7c0cd2b1f01`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:59.180330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff8426a5-6f41-4895-a7d4-d35e2e182e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:59.182307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c0788e4e-3489-425f-946e-afc3eeccdee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.188485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1045/2116] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:58 2022] DELETE /identity/v3/projects/9cb9f7fabbd24bf48b02b8ac2dbfb1c5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:59.194396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5797-2b76-43d1-b3fa-14fa3fa2d672 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.194680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5797-2b76-43d1-b3fa-14fa3fa2d672 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.195571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5797-2b76-43d1-b3fa-14fa3fa2d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.251965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-348c5797-2b76-43d1-b3fa-14fa3fa2d672 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:59.260583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-348c5797-2b76-43d1-b3fa-14fa3fa2d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:59.335329 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:59.448660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1072/2117] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:01:59.458108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8426a5-6f41-4895-a7d4-d35e2e182e14 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:59.461439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff8426a5-6f41-4895-a7d4-d35e2e182e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:59.487452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1046/2118] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:59.495470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2150aa-c6b9-48ef-ad7d-2cfd79474cee None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.495743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2150aa-c6b9-48ef-ad7d-2cfd79474cee None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.498514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2150aa-c6b9-48ef-ad7d-2cfd79474cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.566517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-df2150aa-c6b9-48ef-ad7d-2cfd79474cee None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:01:59.575297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-df2150aa-c6b9-48ef-ad7d-2cfd79474cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:59.607492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1047/2119] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:01:59.620815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2150aa-c6b9-48ef-ad7d-2cfd79474cee None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:59.648619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2150aa-c6b9-48ef-ad7d-2cfd79474cee None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:59.670626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:59.671419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.671798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.672205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.672396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8426a5-6f41-4895-a7d4-d35e2e182e14 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:59.673047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:01:59.674326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:59.677145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:59.690717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b427d38-bce6-4121-b50a-8d1e368bbae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:59.691387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b427d38-bce6-4121-b50a-8d1e368bbae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.691663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b427d38-bce6-4121-b50a-8d1e368bbae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.691936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b427d38-bce6-4121-b50a-8d1e368bbae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.698702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1048/2120] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:01:59.699886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:59.701933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:59.707862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b427d38-bce6-4121-b50a-8d1e368bbae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:59.709306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b427d38-bce6-4121-b50a-8d1e368bbae4 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:59.716998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ece81-a7ab-4ca5-ba62-64ebfef5e25f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:59.729337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:59.730163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.730712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.731106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] PATH_INFO: `/v3/projects/fa648366cee34a47a4d9c88cdb693021` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.733098 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa648366cee34a47a4d9c88cdb693021)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:59.742839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1073/2121] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:01:59.743903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b427d38-bce6-4121-b50a-8d1e368bbae4 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:59.746603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:59.799104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b427d38-bce6-4121-b50a-8d1e368bbae4 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:01:59.833317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121fa53-f995-43d2-9bcc-c91588f02e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:01:59.833979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121fa53-f995-43d2-9bcc-c91588f02e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:01:59.834259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121fa53-f995-43d2-9bcc-c91588f02e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:01:59.834532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121fa53-f995-43d2-9bcc-c91588f02e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:01:59.835249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121fa53-f995-43d2-9bcc-c91588f02e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:01:59.837906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121fa53-f995-43d2-9bcc-c91588f02e50 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:01:59.900937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa648366cee34a47a4d9c88cdb693021', 'request_id': 'req-c242875f-af6f-4e9b-873e-058177c77118'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.906713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1074/2122] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:01:59 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:01:59.907697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121fa53-f995-43d2-9bcc-c91588f02e50 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:59.920618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa648366cee34a47a4d9c88cdb693021', 'request_id': 'req-c242875f-af6f-4e9b-873e-058177c77118'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.935538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa648366cee34a47a4d9c88cdb693021', 'request_id': 'req-c242875f-af6f-4e9b-873e-058177c77118'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.952892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] The token cache is being invalidate because project fa648366cee34a47a4d9c88cdb693021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:01:59.953221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.953960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:01:59.955694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1049/2123] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:01:59 2022] DELETE /identity/v3/projects/fa648366cee34a47a4d9c88cdb693021 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:01:59.956467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:01:59.957859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:01:59.968682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:00.040020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121fa53-f995-43d2-9bcc-c91588f02e50 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:00.047636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:00.049044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:00.049739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:00.050207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:00.051425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:00.054591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:00.097798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1075/2124] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:01:59 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:00.099724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:00.104141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:00.106823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242875f-af6f-4e9b-873e-058177c77118 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:00.138134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3447a-5495-47ca-842c-6da61f01afe7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:00.158321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:00.159977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:00.160729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:00.161471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] PATH_INFO: `/v3/users/eb550625997d4391a97f04bfeb61bec7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:00.164720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb550625997d4391a97f04bfeb61bec7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:00.169369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:00.214875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:00.214875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:00.214875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:00.214875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:00.220510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:00.283541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:00.285690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb550625997d4391a97f04bfeb61bec7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:00.300834 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb550625997d4391a97f04bfeb61bec7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:00.301548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb550625997d4391a97f04bfeb61bec7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:00.302704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb550625997d4391a97f04bfeb61bec7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:00.318704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb550625997d4391a97f04bfeb61bec7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:00.348629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1076/2125] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:00 2022] DELETE /identity/v3/users/eb550625997d4391a97f04bfeb61bec7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:00.350474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:00.352495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:00.359059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:00.360533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:00.409031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1050/2126] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:01:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:00.519702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc426a0e-f6d5-4dbd-ae73-56a4c0a3cab6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:00.529239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558cee2-922f-4f28-9d48-d593536b69d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:00.529920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558cee2-922f-4f28-9d48-d593536b69d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:00.530252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558cee2-922f-4f28-9d48-d593536b69d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:00.530594 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558cee2-922f-4f28-9d48-d593536b69d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:00.531709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558cee2-922f-4f28-9d48-d593536b69d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:00.534159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558cee2-922f-4f28-9d48-d593536b69d7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:00.587061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1077/2127] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:00.590902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:00.592388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:00.611150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f62d9c-1811-4211-8169-74e8f28b6a59 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:00.619087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7284859-7ed4-4bef-9d8b-2d6a6149aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:00.619875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284859-7ed4-4bef-9d8b-2d6a6149aa2a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:00.620149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284859-7ed4-4bef-9d8b-2d6a6149aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:00.620417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284859-7ed4-4bef-9d8b-2d6a6149aa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:00.621164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284859-7ed4-4bef-9d8b-2d6a6149aa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:00.623112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284859-7ed4-4bef-9d8b-2d6a6149aa2a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:00.639685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1051/2128] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:00.643545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558cee2-922f-4f28-9d48-d593536b69d7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:00.656620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558cee2-922f-4f28-9d48-d593536b69d7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:00.670547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:00.671410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:00.671523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:00.671962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] PATH_INFO: `/v3/projects/5eb53b5be1964296b1406c8e753c37fe/users/675f5fc1d2d04be99c2658e3a6b138fd/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:00.733999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb53b5be1964296b1406c8e753c37fe, user_id=675f5fc1d2d04be99c2658e3a6b138fd, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:00.737623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:00.767903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1078/2129] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:00 2022] PUT /identity/v3/projects/5eb53b5be1964296b1406c8e753c37fe/users/675f5fc1d2d04be99c2658e3a6b138fd/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:00.781202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c95bed-5c93-4554-9445-4ca112d919b5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:00.782160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c95bed-5c93-4554-9445-4ca112d919b5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:00.783060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c95bed-5c93-4554-9445-4ca112d919b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:00.838637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-43c95bed-5c93-4554-9445-4ca112d919b5 None None] MFA Rules not processed for user `675f5fc1d2d04be99c2658e3a6b138fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:00.842358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-43c95bed-5c93-4554-9445-4ca112d919b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:00.855586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:00.861227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:00.936795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:00.959294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1052/2130] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:00.975771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c95bed-5c93-4554-9445-4ca112d919b5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:00.978247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-43c95bed-5c93-4554-9445-4ca112d919b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:00.996930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac945-2763-4797-adf4-f9acedb5af20 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:01.002538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:01.003361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:01.003643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:01.003919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] PATH_INFO: `/v3/projects/9f4ed1939bfc40ceaf5df0bea010747a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:01.005305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4ed1939bfc40ceaf5df0bea010747a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:01.008511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:01.064811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:01.081607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4ed1939bfc40ceaf5df0bea010747a', 'request_id': 'req-457a4ef6-b7cf-4ee2-9075-3595e501e019'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.092987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4ed1939bfc40ceaf5df0bea010747a', 'request_id': 'req-457a4ef6-b7cf-4ee2-9075-3595e501e019'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.119401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c95bed-5c93-4554-9445-4ca112d919b5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:01.129041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4ed1939bfc40ceaf5df0bea010747a', 'request_id': 'req-457a4ef6-b7cf-4ee2-9075-3595e501e019'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.182634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] The token cache is being invalidate because project 9f4ed1939bfc40ceaf5df0bea010747a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:01.183001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.184826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.191872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1079/2131] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:00 2022] DELETE /identity/v3/projects/9f4ed1939bfc40ceaf5df0bea010747a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:01.192798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:01.197467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:01.294551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:01.295741 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:01.296180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:01.296606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:01.301243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:01.308411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a4ef6-b7cf-4ee2-9075-3595e501e019 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:01.315483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:01.316732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:01.317529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:01.317819 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] PATH_INFO: `/v3/users/30f9f683f1714834a65aa724d00b9f42` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:01.319254 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f9f683f1714834a65aa724d00b9f42)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:01.321993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:01.428659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f9f683f1714834a65aa724d00b9f42'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.445483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f9f683f1714834a65aa724d00b9f42'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.446331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f9f683f1714834a65aa724d00b9f42'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.447403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f9f683f1714834a65aa724d00b9f42'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.457022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:01.458962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:01.468805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fbcbc82-97e7-4b8a-9b69-02472c6fc466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f9f683f1714834a65aa724d00b9f42'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:01.472166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1053/2132] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:02:01.494544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1080/2133] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:01 2022] DELETE /identity/v3/users/30f9f683f1714834a65aa724d00b9f42 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:02.764704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:02.786005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e90301-2ad6-4907-bb56-5d319937ce56 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:02.904153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:02.904153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:02.904153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:02.904153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] PATH_INFO: `/v3/projects/369e62bfc1504a248b11370bd0f97570` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:02.906296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71512069-f378-4444-90d5-ff80323da5e3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:02.906863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=369e62bfc1504a248b11370bd0f97570)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:02.907539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71512069-f378-4444-90d5-ff80323da5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:02.907981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71512069-f378-4444-90d5-ff80323da5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:02.908375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:02.920489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:02.951752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-71512069-f378-4444-90d5-ff80323da5e3 None None] MFA Rules not processed for user `89e9adac7ad241ee9081ab600342af9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:02.955949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-71512069-f378-4444-90d5-ff80323da5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:02.997026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369e62bfc1504a248b11370bd0f97570', 'request_id': 'req-f0c70c83-3837-4198-a0f1-cdc5db771720'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:03.004113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369e62bfc1504a248b11370bd0f97570', 'request_id': 'req-f0c70c83-3837-4198-a0f1-cdc5db771720'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:03.019890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369e62bfc1504a248b11370bd0f97570', 'request_id': 'req-f0c70c83-3837-4198-a0f1-cdc5db771720'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:03.035257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:03.047399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] The token cache is being invalidate because project 369e62bfc1504a248b11370bd0f97570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:03.047703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:03.048544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f0c70c83-3837-4198-a0f1-cdc5db771720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:03.050611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1054/2134] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:02 2022] DELETE /identity/v3/projects/369e62bfc1504a248b11370bd0f97570 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:03.056064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb783-38c9-4ca2-aab7-183fb1c5f59a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.056342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb783-38c9-4ca2-aab7-183fb1c5f59a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.056615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb783-38c9-4ca2-aab7-183fb1c5f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.106860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1081/2135] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:03.106860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71512069-f378-4444-90d5-ff80323da5e3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.107153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-57beb783-38c9-4ca2-aab7-183fb1c5f59a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:03.107231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-71512069-f378-4444-90d5-ff80323da5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:03.107304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-57beb783-38c9-4ca2-aab7-183fb1c5f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:03.118676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71512069-f378-4444-90d5-ff80323da5e3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:03.231068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1055/2136] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:03.238492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469970a-207a-4187-8511-ce51131543c3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.238854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469970a-207a-4187-8511-ce51131543c3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.239185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469970a-207a-4187-8511-ce51131543c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.280429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d469970a-207a-4187-8511-ce51131543c3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:03.282123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d469970a-207a-4187-8511-ce51131543c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:03.285454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994a8da-e911-4b29-bc61-a80fa4d13451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:03.286072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994a8da-e911-4b29-bc61-a80fa4d13451 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.286351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994a8da-e911-4b29-bc61-a80fa4d13451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.286623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994a8da-e911-4b29-bc61-a80fa4d13451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.287307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994a8da-e911-4b29-bc61-a80fa4d13451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:03.289422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994a8da-e911-4b29-bc61-a80fa4d13451 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:03.292911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1056/2137] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:02:03.297228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469970a-207a-4187-8511-ce51131543c3 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.311627 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469970a-207a-4187-8511-ce51131543c3 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:03.316683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:03.317298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.317575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.317848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.318495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:03.318867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:03.321080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:03.338935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1057/2138] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:03.339841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.348045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1082/2139] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:03 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:03.352864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994a8da-e911-4b29-bc61-a80fa4d13451 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.355235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3364-1f57-445f-bf52-b87b358bb17d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:03.459748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994a8da-e911-4b29-bc61-a80fa4d13451 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:03.466667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f142-2ffe-4bfd-99a3-859a3ee85480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:03.467599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f142-2ffe-4bfd-99a3-859a3ee85480 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.467962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f142-2ffe-4bfd-99a3-859a3ee85480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.468342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f142-2ffe-4bfd-99a3-859a3ee85480 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.469336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f142-2ffe-4bfd-99a3-859a3ee85480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:03.471897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f142-2ffe-4bfd-99a3-859a3ee85480 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:03.487564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378bd3a-8d57-4c21-b2a1-0da36e4f8375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:03.488371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378bd3a-8d57-4c21-b2a1-0da36e4f8375 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.488722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378bd3a-8d57-4c21-b2a1-0da36e4f8375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.489103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378bd3a-8d57-4c21-b2a1-0da36e4f8375 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.489816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378bd3a-8d57-4c21-b2a1-0da36e4f8375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:03.493757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378bd3a-8d57-4c21-b2a1-0da36e4f8375 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:03.529200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1083/2140] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:03 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:02:03.532703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f142-2ffe-4bfd-99a3-859a3ee85480 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.548960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:03.549438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f142-2ffe-4bfd-99a3-859a3ee85480 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:03.555847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e219e-7633-4d13-91ed-6af81d7b2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:03.556528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e219e-7633-4d13-91ed-6af81d7b2390 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.556877 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e219e-7633-4d13-91ed-6af81d7b2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.557085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e219e-7633-4d13-91ed-6af81d7b2390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.558525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e219e-7633-4d13-91ed-6af81d7b2390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:03.560308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e219e-7633-4d13-91ed-6af81d7b2390 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:03.560443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1058/2141] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:03 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:03.565375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378bd3a-8d57-4c21-b2a1-0da36e4f8375 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.581287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1084/2142] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:03.585279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e219e-7633-4d13-91ed-6af81d7b2390 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.605933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e219e-7633-4d13-91ed-6af81d7b2390 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:03.687205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:03.732904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0651d2-68af-4cc5-a530-16ded897fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:03.733717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0651d2-68af-4cc5-a530-16ded897fc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.734089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0651d2-68af-4cc5-a530-16ded897fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.734456 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0651d2-68af-4cc5-a530-16ded897fc07 admin admin] PATH_INFO: `/v3/projects/afea937b16e74772860e6f75165cc1ad/users/08bef1ffe89540369203e69fcc06d52d/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.734858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378bd3a-8d57-4c21-b2a1-0da36e4f8375 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:03.747818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe8e8-d2d4-4063-8897-e7910624a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:03.748634 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe8e8-d2d4-4063-8897-e7910624a17d admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.748921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe8e8-d2d4-4063-8897-e7910624a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.749198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe8e8-d2d4-4063-8897-e7910624a17d admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.750048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbe8e8-d2d4-4063-8897-e7910624a17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:03.752463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbe8e8-d2d4-4063-8897-e7910624a17d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:03.759462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0651d2-68af-4cc5-a530-16ded897fc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afea937b16e74772860e6f75165cc1ad, user_id=08bef1ffe89540369203e69fcc06d52d, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:03.763181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0651d2-68af-4cc5-a530-16ded897fc07 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:03.795418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1085/2143] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:03 2022] PUT /identity/v3/projects/afea937b16e74772860e6f75165cc1ad/users/08bef1ffe89540369203e69fcc06d52d/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:03.797251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0651d2-68af-4cc5-a530-16ded897fc07 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.815161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1059/2144] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:03 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:02:03.816083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe8e8-d2d4-4063-8897-e7910624a17d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:03.840311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe8e8-d2d4-4063-8897-e7910624a17d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:03.973743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:03.974555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:03.974693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:03.974971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:03.975638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:03.977977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:03.985110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0651d2-68af-4cc5-a530-16ded897fc07 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:04.009689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1060/2145] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:04.009689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:04.018336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59d5f-8f95-49ed-a2e0-41cd9e480fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:04.019206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59d5f-8f95-49ed-a2e0-41cd9e480fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:04.019489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59d5f-8f95-49ed-a2e0-41cd9e480fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:04.019766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59d5f-8f95-49ed-a2e0-41cd9e480fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:04.020247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:04.020432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59d5f-8f95-49ed-a2e0-41cd9e480fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:04.022960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59d5f-8f95-49ed-a2e0-41cd9e480fc9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:04.055287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40574-6f3f-4a06-bf22-7a121e7e0c1c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:04.060434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1086/2146] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:04.061417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59d5f-8f95-49ed-a2e0-41cd9e480fc9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:04.065137 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:04.068249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:04.070653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:04.071983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] PATH_INFO: `/v3/users/720c0d05f7c84582a78f0922231b8593` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:04.074887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] RBAC: Authorizing `identity:delete_user(user_id=720c0d05f7c84582a78f0922231b8593)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:04.079272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:04.085742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59d5f-8f95-49ed-a2e0-41cd9e480fc9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:04.102431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bbc38-f2b8-461b-a36e-1db215a035ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:04.102431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbc38-f2b8-461b-a36e-1db215a035ee admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:04.102431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbc38-f2b8-461b-a36e-1db215a035ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:04.102431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbc38-f2b8-461b-a36e-1db215a035ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:04.103034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bbc38-f2b8-461b-a36e-1db215a035ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:04.103988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bbc38-f2b8-461b-a36e-1db215a035ee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:04.122313 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1087/2147] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:04.123584 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bbc38-f2b8-461b-a36e-1db215a035ee admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:04.141451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bbc38-f2b8-461b-a36e-1db215a035ee admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:04.148265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc6850-e19b-4ee6-8314-fa82a456dc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:04.149391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6850-e19b-4ee6-8314-fa82a456dc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:04.149826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6850-e19b-4ee6-8314-fa82a456dc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:04.150267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6850-e19b-4ee6-8314-fa82a456dc1d admin admin] PATH_INFO: `/v3/projects/afea937b16e74772860e6f75165cc1ad/users/08bef1ffe89540369203e69fcc06d52d/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:04.154185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6850-e19b-4ee6-8314-fa82a456dc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afea937b16e74772860e6f75165cc1ad, user_id=08bef1ffe89540369203e69fcc06d52d, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:04.157957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6850-e19b-4ee6-8314-fa82a456dc1d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:04.198807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1088/2148] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:04 2022] PUT /identity/v3/projects/afea937b16e74772860e6f75165cc1ad/users/08bef1ffe89540369203e69fcc06d52d/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:04.199801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc6850-e19b-4ee6-8314-fa82a456dc1d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:04.233515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720c0d05f7c84582a78f0922231b8593'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:04.257048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720c0d05f7c84582a78f0922231b8593'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:04.258642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720c0d05f7c84582a78f0922231b8593'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:04.259645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720c0d05f7c84582a78f0922231b8593'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:04.277904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0ea9629f-60df-4aba-9968-7d1f0743203e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720c0d05f7c84582a78f0922231b8593'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:04.322254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:04.354265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1061/2149] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:04 2022] DELETE /identity/v3/users/720c0d05f7c84582a78f0922231b8593 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:04.356178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfaa4a-fde5-4c57-a469-2b78a0aea868 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:04.356644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfaa4a-fde5-4c57-a469-2b78a0aea868 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:04.356925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfaa4a-fde5-4c57-a469-2b78a0aea868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:04.403782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dfdfaa4a-fde5-4c57-a469-2b78a0aea868 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:04.405405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dfdfaa4a-fde5-4c57-a469-2b78a0aea868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:04.407874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc6850-e19b-4ee6-8314-fa82a456dc1d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:04.484084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:04.502224 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1062/2150] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:02:04.519698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ed5b8-fa48-4dbf-8321-3e8d7673297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:04.520689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ed5b8-fa48-4dbf-8321-3e8d7673297d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:04.521161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ed5b8-fa48-4dbf-8321-3e8d7673297d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:04.521624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ed5b8-fa48-4dbf-8321-3e8d7673297d admin admin] PATH_INFO: `/v3/projects/bac91f42c503434f989cc174c6c16fd4/users/5c62b94ce9ee4017bb77c09cb784df24/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:04.523359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfaa4a-fde5-4c57-a469-2b78a0aea868 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:04.526596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dfdfaa4a-fde5-4c57-a469-2b78a0aea868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:04.556358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ed5b8-fa48-4dbf-8321-3e8d7673297d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac91f42c503434f989cc174c6c16fd4, user_id=5c62b94ce9ee4017bb77c09cb784df24, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:04.566423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ed5b8-fa48-4dbf-8321-3e8d7673297d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:04.595258 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1089/2151] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:04 2022] PUT /identity/v3/projects/bac91f42c503434f989cc174c6c16fd4/users/5c62b94ce9ee4017bb77c09cb784df24/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:04.607501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4372d6-db0a-462d-82ba-2ea73062916a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:04.608079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4372d6-db0a-462d-82ba-2ea73062916a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:04.608489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4372d6-db0a-462d-82ba-2ea73062916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:04.686342 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8d4372d6-db0a-462d-82ba-2ea73062916a None None] MFA Rules not processed for user `5c62b94ce9ee4017bb77c09cb784df24`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:04.688612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d4372d6-db0a-462d-82ba-2ea73062916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:04.740261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfaa4a-fde5-4c57-a469-2b78a0aea868 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:04.840960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f65d-05b9-4839-956c-4fd7d3f2df2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:04.843273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f65d-05b9-4839-956c-4fd7d3f2df2f service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:04.843569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f65d-05b9-4839-956c-4fd7d3f2df2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:04.849305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f65d-05b9-4839-956c-4fd7d3f2df2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:04.849649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1090/2152] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:02:04.850551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4372d6-db0a-462d-82ba-2ea73062916a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:04.852631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d4372d6-db0a-462d-82ba-2ea73062916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:04.965939 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f65d-05b9-4839-956c-4fd7d3f2df2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:04.967906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f65d-05b9-4839-956c-4fd7d3f2df2f service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:04.989012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4372d6-db0a-462d-82ba-2ea73062916a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:04.990498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1063/2153] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:04.999251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2850194-5baa-46e2-b7e8-3129632b2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:05.000196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2850194-5baa-46e2-b7e8-3129632b2d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:05.000577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2850194-5baa-46e2-b7e8-3129632b2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:05.000974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2850194-5baa-46e2-b7e8-3129632b2d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:05.001732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2850194-5baa-46e2-b7e8-3129632b2d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:05.004147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2850194-5baa-46e2-b7e8-3129632b2d47 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:05.062277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1091/2154] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:04 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:05.075704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f65d-05b9-4839-956c-4fd7d3f2df2f service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:05.081912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:05.087617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f65d-05b9-4839-956c-4fd7d3f2df2f service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:05.165023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ae01-50d4-4616-88fa-1f55db16fc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:05.165533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ae01-50d4-4616-88fa-1f55db16fc6f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:05.166106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ae01-50d4-4616-88fa-1f55db16fc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:05.166106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ae01-50d4-4616-88fa-1f55db16fc6f admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:05.166709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2ae01-50d4-4616-88fa-1f55db16fc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:05.171549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2ae01-50d4-4616-88fa-1f55db16fc6f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:05.214788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1064/2155] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:05 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:05.216038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2850194-5baa-46e2-b7e8-3129632b2d47 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:05.228946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2850194-5baa-46e2-b7e8-3129632b2d47 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:05.236943 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13478c1-1f1e-4735-9bb9-be5ec622e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:05.237846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13478c1-1f1e-4735-9bb9-be5ec622e754 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:05.238340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13478c1-1f1e-4735-9bb9-be5ec622e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:05.239493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13478c1-1f1e-4735-9bb9-be5ec622e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:05.240507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13478c1-1f1e-4735-9bb9-be5ec622e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:05.243578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13478c1-1f1e-4735-9bb9-be5ec622e754 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:05.261401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1092/2156] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:05.266807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ae01-50d4-4616-88fa-1f55db16fc6f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:05.281851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ae01-50d4-4616-88fa-1f55db16fc6f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:05.290217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21945d1-4043-4f42-872a-3a1893626e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:05.292296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21945d1-4043-4f42-872a-3a1893626e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:05.293096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21945d1-4043-4f42-872a-3a1893626e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:05.293583 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21945d1-4043-4f42-872a-3a1893626e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:05.294499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21945d1-4043-4f42-872a-3a1893626e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:05.303303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21945d1-4043-4f42-872a-3a1893626e2c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:05.321790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1065/2157] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:05.325364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13478c1-1f1e-4735-9bb9-be5ec622e754 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:05.340126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13478c1-1f1e-4735-9bb9-be5ec622e754 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:05.345897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:05.346688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:05.347017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:05.347295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] PATH_INFO: `/v3/projects/8db6b3aeffb14b69ac1d2f856f6432e0/users/4ba6642075d845f09ccfd1130981d4cb/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:05.368222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db6b3aeffb14b69ac1d2f856f6432e0, user_id=4ba6642075d845f09ccfd1130981d4cb, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:05.371787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:05.418579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1093/2158] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:05 2022] PUT /identity/v3/projects/8db6b3aeffb14b69ac1d2f856f6432e0/users/4ba6642075d845f09ccfd1130981d4cb/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:05.429901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782e91-3328-4828-8930-967f26931a83 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:05.430824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782e91-3328-4828-8930-967f26931a83 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:05.431250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c782e91-3328-4828-8930-967f26931a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:05.465507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:05.468091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:05.475459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:05.518211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6c782e91-3328-4828-8930-967f26931a83 None None] MFA Rules not processed for user `4ba6642075d845f09ccfd1130981d4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:05.519736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6c782e91-3328-4828-8930-967f26931a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:05.655395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c15ab-a062-4049-911d-dc66fcb79e69 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:05.677624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1066/2159] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:05.683440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c782e91-3328-4828-8930-967f26931a83 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:05.690399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:05.691882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:05.697110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:05.697602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] PATH_INFO: `/v3/users/675f5fc1d2d04be99c2658e3a6b138fd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:05.699706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=675f5fc1d2d04be99c2658e3a6b138fd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:05.707400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:05.707689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c782e91-3328-4828-8930-967f26931a83 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:05.725562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd7c8-0515-4f46-969b-ee284520aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:05.726241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd7c8-0515-4f46-969b-ee284520aa16 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:05.726609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd7c8-0515-4f46-969b-ee284520aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:05.727193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd7c8-0515-4f46-969b-ee284520aa16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:05.727986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fd7c8-0515-4f46-969b-ee284520aa16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:05.729842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fd7c8-0515-4f46-969b-ee284520aa16 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:05.796088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1067/2160] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:05 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:05.800182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd7c8-0515-4f46-969b-ee284520aa16 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:05.825780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675f5fc1d2d04be99c2658e3a6b138fd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:05.838589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675f5fc1d2d04be99c2658e3a6b138fd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:05.839640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675f5fc1d2d04be99c2658e3a6b138fd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:05.840545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675f5fc1d2d04be99c2658e3a6b138fd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:05.861550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675f5fc1d2d04be99c2658e3a6b138fd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:05.910690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1094/2161] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:05 2022] DELETE /identity/v3/users/675f5fc1d2d04be99c2658e3a6b138fd => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:05.911691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:05.913334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:05.921169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:05.953540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd7c8-0515-4f46-969b-ee284520aa16 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:06.018874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c1ae-e929-46de-a924-f6454c2cd1ef admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:06.027429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:06.028220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:06.028618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:06.030140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] PATH_INFO: `/v3/projects/1a0816ee141f4bf1b3d10ed6c5507558` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:06.031545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0816ee141f4bf1b3d10ed6c5507558)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:06.034346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:06.075517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:06.099707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a9b1f-493f-409c-afbf-05c4c2f3f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:06.102287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9b1f-493f-409c-afbf-05c4c2f3f121 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:06.102854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9b1f-493f-409c-afbf-05c4c2f3f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:06.103477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9b1f-493f-409c-afbf-05c4c2f3f121 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:06.105420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a9b1f-493f-409c-afbf-05c4c2f3f121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:06.110077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a9b1f-493f-409c-afbf-05c4c2f3f121 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:06.112880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0816ee141f4bf1b3d10ed6c5507558', 'request_id': 'req-7aeb2899-facc-46a6-ba51-3a95b555ee78'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.149971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0816ee141f4bf1b3d10ed6c5507558', 'request_id': 'req-7aeb2899-facc-46a6-ba51-3a95b555ee78'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.170625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0816ee141f4bf1b3d10ed6c5507558', 'request_id': 'req-7aeb2899-facc-46a6-ba51-3a95b555ee78'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.178901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1068/2162] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:05 2022] POST /identity/v3/users => generated 299 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:06.180698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c086-0265-4491-a919-25275c577c2d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:06.181127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c086-0265-4491-a919-25275c577c2d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:06.183202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24c086-0265-4491-a919-25275c577c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:06.192236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] The token cache is being invalidate because project 1a0816ee141f4bf1b3d10ed6c5507558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:06.192626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.198363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.202846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1095/2163] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:05 2022] DELETE /identity/v3/projects/1a0816ee141f4bf1b3d10ed6c5507558 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:06.202846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:06.203125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:06.248903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4b24c086-0265-4491-a919-25275c577c2d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:06.253115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4b24c086-0265-4491-a919-25275c577c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:06.363638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1069/2164] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:06.364906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24c086-0265-4491-a919-25275c577c2d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:06.367315 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4b24c086-0265-4491-a919-25275c577c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:06.396225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24c086-0265-4491-a919-25275c577c2d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:06.407584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:06.408383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:06.408758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:06.409134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] PATH_INFO: `/v3/users/70819fb4b4f548b48670b7c0cd2b1f01` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:06.410423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70819fb4b4f548b48670b7c0cd2b1f01)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:06.412439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2899-facc-46a6-ba51-3a95b555ee78 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:06.412573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:06.419765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:06.420725 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:06.421641 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:06.421961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:06.423155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:06.450424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:06.495170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1096/2165] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:06.495170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:06.496742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:06.511446 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70819fb4b4f548b48670b7c0cd2b1f01'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.526908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70819fb4b4f548b48670b7c0cd2b1f01'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.527713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70819fb4b4f548b48670b7c0cd2b1f01'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.528483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70819fb4b4f548b48670b7c0cd2b1f01'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.541697 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70819fb4b4f548b48670b7c0cd2b1f01'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:06.575408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:06.590994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1070/2166] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:06 2022] DELETE /identity/v3/users/70819fb4b4f548b48670b7c0cd2b1f01 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:06.591326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:06.594638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:06.638292 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a570-ec45-40e9-af5a-5c1a9cc6554c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:06.748958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d8fa-015c-4b60-978b-d8167f6d1496 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:06.753995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36903-5c1e-42a0-8c09-3e00c3c34377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:06.754912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36903-5c1e-42a0-8c09-3e00c3c34377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:06.755447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36903-5c1e-42a0-8c09-3e00c3c34377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:06.755730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36903-5c1e-42a0-8c09-3e00c3c34377 admin admin] PATH_INFO: `/v3/projects/276b0fd422ef4f8b81981050a7fe22ab/users/191dadb5203c4f89bd8c59f3d3f4d2f2/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:06.774646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:06.776318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:06.777090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:06.777735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:06.779084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c36903-5c1e-42a0-8c09-3e00c3c34377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276b0fd422ef4f8b81981050a7fe22ab, user_id=191dadb5203c4f89bd8c59f3d3f4d2f2, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:06.782603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c36903-5c1e-42a0-8c09-3e00c3c34377 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:06.783312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:06.806020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1071/2167] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:06 2022] PUT /identity/v3/projects/276b0fd422ef4f8b81981050a7fe22ab/users/191dadb5203c4f89bd8c59f3d3f4d2f2/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:06.810856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36903-5c1e-42a0-8c09-3e00c3c34377 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:06.822674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:06.825607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:06.858806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1097/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:06.918955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36903-5c1e-42a0-8c09-3e00c3c34377 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:06.928945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ffe81-82a0-49c1-a35e-db31f1ae295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:06.934783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffe81-82a0-49c1-a35e-db31f1ae295f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:06.934783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffe81-82a0-49c1-a35e-db31f1ae295f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:06.934783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffe81-82a0-49c1-a35e-db31f1ae295f admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:06.936009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ffe81-82a0-49c1-a35e-db31f1ae295f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:06.937432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ffe81-82a0-49c1-a35e-db31f1ae295f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:06.970041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1072/2169] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:06.974272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:07.005025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f3c2-8c57-4f3e-83a0-739a8720a32c service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:07.013544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:07.014228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:07.014509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:07.016034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] PATH_INFO: `/v3/projects/276b0fd422ef4f8b81981050a7fe22ab/users/191dadb5203c4f89bd8c59f3d3f4d2f2/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:07.018717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] RBAC: Authorizing `identity:create_grant(project_id=276b0fd422ef4f8b81981050a7fe22ab, user_id=191dadb5203c4f89bd8c59f3d3f4d2f2, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:07.022569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:07.027460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:07.055662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1098/2170] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:06 2022] PUT /identity/v3/projects/276b0fd422ef4f8b81981050a7fe22ab/users/191dadb5203c4f89bd8c59f3d3f4d2f2/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:07.069155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ed4b-04ca-4ead-9420-1a08bdf63238 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:07.069579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ed4b-04ca-4ead-9420-1a08bdf63238 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:07.069940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ed4b-04ca-4ead-9420-1a08bdf63238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:07.151510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a704ed4b-04ca-4ead-9420-1a08bdf63238 None None] MFA Rules not processed for user `191dadb5203c4f89bd8c59f3d3f4d2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:07.154870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a704ed4b-04ca-4ead-9420-1a08bdf63238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:07.275199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1073/2171] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:07.288420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:07.294310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:07.405964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6e728-5f60-48e2-a8d2-d3d149f2806b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:07.411602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083642ff-9dd0-498c-bed1-822a4e87a1b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:07.412236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083642ff-9dd0-498c-bed1-822a4e87a1b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:07.412876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083642ff-9dd0-498c-bed1-822a4e87a1b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:07.413233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083642ff-9dd0-498c-bed1-822a4e87a1b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:07.416960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-083642ff-9dd0-498c-bed1-822a4e87a1b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:07.549322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083642ff-9dd0-498c-bed1-822a4e87a1b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:07.551174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083642ff-9dd0-498c-bed1-822a4e87a1b6 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:07.584112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1099/2172] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:02:07.788338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704ed4b-04ca-4ead-9420-1a08bdf63238 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:07.790209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a704ed4b-04ca-4ead-9420-1a08bdf63238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:07.796369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:07.996755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704ed4b-04ca-4ead-9420-1a08bdf63238 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:08.011876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83524397-8182-4410-96d8-334765f6392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:08.012750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524397-8182-4410-96d8-334765f6392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.013212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524397-8182-4410-96d8-334765f6392a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.013688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524397-8182-4410-96d8-334765f6392a admin admin] PATH_INFO: `/v3/projects/da8fb1a590794896b2dd85894260a0c7` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:08.017501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83524397-8182-4410-96d8-334765f6392a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8fb1a590794896b2dd85894260a0c7)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:08.019902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83524397-8182-4410-96d8-334765f6392a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:08.129248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-83524397-8182-4410-96d8-334765f6392a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8fb1a590794896b2dd85894260a0c7', 'request_id': 'req-83524397-8182-4410-96d8-334765f6392a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.136486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-83524397-8182-4410-96d8-334765f6392a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8fb1a590794896b2dd85894260a0c7', 'request_id': 'req-83524397-8182-4410-96d8-334765f6392a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.165560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-83524397-8182-4410-96d8-334765f6392a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8fb1a590794896b2dd85894260a0c7', 'request_id': 'req-83524397-8182-4410-96d8-334765f6392a'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.185868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-83524397-8182-4410-96d8-334765f6392a admin admin] The token cache is being invalidate because project da8fb1a590794896b2dd85894260a0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:08.186178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-83524397-8182-4410-96d8-334765f6392a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.200888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-83524397-8182-4410-96d8-334765f6392a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.202467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1074/2173] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:07 2022] DELETE /identity/v3/projects/da8fb1a590794896b2dd85894260a0c7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:08.207349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3101-294a-4df7-9369-6aa2aa0268cd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.207823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3101-294a-4df7-9369-6aa2aa0268cd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.207901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3101-294a-4df7-9369-6aa2aa0268cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:08.238657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-85cc3101-294a-4df7-9369-6aa2aa0268cd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:08.240244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-85cc3101-294a-4df7-9369-6aa2aa0268cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:08.402099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1100/2174] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:08.412026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9adc19-fcd0-4a23-bb4b-a9a193cc173d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.412318 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9adc19-fcd0-4a23-bb4b-a9a193cc173d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.412636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9adc19-fcd0-4a23-bb4b-a9a193cc173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:08.424875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3101-294a-4df7-9369-6aa2aa0268cd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:08.426312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-85cc3101-294a-4df7-9369-6aa2aa0268cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:08.450208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-fb9adc19-fcd0-4a23-bb4b-a9a193cc173d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:08.451532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fb9adc19-fcd0-4a23-bb4b-a9a193cc173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:08.454274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3101-294a-4df7-9369-6aa2aa0268cd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:08.470988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:08.472644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.474050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.477196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] PATH_INFO: `/v3/projects/5eb53b5be1964296b1406c8e753c37fe` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:08.480087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1075/2175] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:08.480654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb53b5be1964296b1406c8e753c37fe)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:08.484473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9adc19-fcd0-4a23-bb4b-a9a193cc173d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:08.485573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:08.499692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9adc19-fcd0-4a23-bb4b-a9a193cc173d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:08.517871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:08.518251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.518564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.518877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:08.519538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:08.519846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:08.521474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:08.549397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1076/2176] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:08.550466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:08.596204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e6e2-e05b-43f7-a9fa-323da7888e12 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:08.621840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:08.633702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb53b5be1964296b1406c8e753c37fe', 'request_id': 'req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.649744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb53b5be1964296b1406c8e753c37fe', 'request_id': 'req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.666860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb53b5be1964296b1406c8e753c37fe', 'request_id': 'req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.688816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:08.689506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.689791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.690076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:08.690925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:08.693828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:08.700451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] The token cache is being invalidate because project 5eb53b5be1964296b1406c8e753c37fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:08.702568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.704074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97c2f7ef-5f96-4ab9-9656-12e9f198ca69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:08.710389 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1101/2177] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:08 2022] DELETE /identity/v3/projects/5eb53b5be1964296b1406c8e753c37fe => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:08.721146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d644762-b97c-4580-9bc6-2d039521e9a2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.722213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d644762-b97c-4580-9bc6-2d039521e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.722513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d644762-b97c-4580-9bc6-2d039521e9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:08.734034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:08.751698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1077/2178] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:08 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:08.756534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:08.763858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:08.792213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8d644762-b97c-4580-9bc6-2d039521e9a2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:08.793452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d644762-b97c-4580-9bc6-2d039521e9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:08.950948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87785278-d3e9-465d-9aa0-babf547cacdb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:08.964009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff3c8-1a65-4e01-a401-869b3068093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:08.964798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff3c8-1a65-4e01-a401-869b3068093d admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.965095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff3c8-1a65-4e01-a401-869b3068093d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.965353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff3c8-1a65-4e01-a401-869b3068093d admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:08.966004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ff3c8-1a65-4e01-a401-869b3068093d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:08.969159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ff3c8-1a65-4e01-a401-869b3068093d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:08.971970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1102/2179] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:08.981709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee105f-52a7-4948-bf70-d32bc9b48c08 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:08.982011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee105f-52a7-4948-bf70-d32bc9b48c08 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:08.982281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee105f-52a7-4948-bf70-d32bc9b48c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.010846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-96ee105f-52a7-4948-bf70-d32bc9b48c08 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:09.012460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-96ee105f-52a7-4948-bf70-d32bc9b48c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:09.019706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1078/2180] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:08 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:09.021432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff3c8-1a65-4e01-a401-869b3068093d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.052286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1103/2181] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:09.053494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee105f-52a7-4948-bf70-d32bc9b48c08 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.060104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff3c8-1a65-4e01-a401-869b3068093d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.080521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df260e-ca4b-4740-8f7f-97292526faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.081429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df260e-ca4b-4740-8f7f-97292526faf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.081862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df260e-ca4b-4740-8f7f-97292526faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.082273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df260e-ca4b-4740-8f7f-97292526faf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.083532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df260e-ca4b-4740-8f7f-97292526faf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.085341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df260e-ca4b-4740-8f7f-97292526faf3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:09.091157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee105f-52a7-4948-bf70-d32bc9b48c08 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.103461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1079/2182] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:09.110640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.113975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.114341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.115536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.115815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:09.116246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.118989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df260e-ca4b-4740-8f7f-97292526faf3 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.119853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:09.152309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df260e-ca4b-4740-8f7f-97292526faf3 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.169973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1104/2183] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:09.170778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.178233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb765da-eae3-4a34-9b88-c5ddc3595a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.180642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb765da-eae3-4a34-9b88-c5ddc3595a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.183468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb765da-eae3-4a34-9b88-c5ddc3595a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.185671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb765da-eae3-4a34-9b88-c5ddc3595a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.188292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb765da-eae3-4a34-9b88-c5ddc3595a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.192872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb765da-eae3-4a34-9b88-c5ddc3595a2c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:09.197206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114462e2-ba37-4762-aedd-56e73490ba49 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.212650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb4de-ac67-4260-b450-3c4b27d4b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.213920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb4de-ac67-4260-b450-3c4b27d4b13a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.220052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb4de-ac67-4260-b450-3c4b27d4b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.220969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb4de-ac67-4260-b450-3c4b27d4b13a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.223641 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bb4de-ac67-4260-b450-3c4b27d4b13a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.225585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1080/2184] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:09.227617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb765da-eae3-4a34-9b88-c5ddc3595a2c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.228887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bb4de-ac67-4260-b450-3c4b27d4b13a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:09.252004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb765da-eae3-4a34-9b88-c5ddc3595a2c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.263542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571965ee-cbdd-4b20-ae33-5c084a048b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.264599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571965ee-cbdd-4b20-ae33-5c084a048b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.266144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571965ee-cbdd-4b20-ae33-5c084a048b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.266639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571965ee-cbdd-4b20-ae33-5c084a048b8e admin admin] PATH_INFO: `/v3/projects/6579c4c730d94d8a980fc5120eeb5e5b/users/2ef44dcb73964827a609be1a07a4b143/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.317484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1105/2185] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:09 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:02:09.320156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb4de-ac67-4260-b450-3c4b27d4b13a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.325426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571965ee-cbdd-4b20-ae33-5c084a048b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579c4c730d94d8a980fc5120eeb5e5b, user_id=2ef44dcb73964827a609be1a07a4b143, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.329524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571965ee-cbdd-4b20-ae33-5c084a048b8e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:09.384543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1081/2186] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:09 2022] PUT /identity/v3/projects/6579c4c730d94d8a980fc5120eeb5e5b/users/2ef44dcb73964827a609be1a07a4b143/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:09.396152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3264f-e0cf-4be8-b90b-3ea9ef0069eb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.399013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3264f-e0cf-4be8-b90b-3ea9ef0069eb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.399342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3264f-e0cf-4be8-b90b-3ea9ef0069eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.465535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-36d3264f-e0cf-4be8-b90b-3ea9ef0069eb None None] MFA Rules not processed for user `2ef44dcb73964827a609be1a07a4b143`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:09.466814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-36d3264f-e0cf-4be8-b90b-3ea9ef0069eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:09.504000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb4de-ac67-4260-b450-3c4b27d4b13a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.578502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:09.627974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1082/2187] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:09.628859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3264f-e0cf-4be8-b90b-3ea9ef0069eb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.632383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-36d3264f-e0cf-4be8-b90b-3ea9ef0069eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:09.638793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa706b-f852-41f7-ac2b-56f0801ae538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.639422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa706b-f852-41f7-ac2b-56f0801ae538 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.639702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa706b-f852-41f7-ac2b-56f0801ae538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.639977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa706b-f852-41f7-ac2b-56f0801ae538 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.641331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa706b-f852-41f7-ac2b-56f0801ae538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.667125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa706b-f852-41f7-ac2b-56f0801ae538 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:09.687675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3264f-e0cf-4be8-b90b-3ea9ef0069eb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.713376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.714022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.714296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.716299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] PATH_INFO: `/v3/users/af82c99ccd584433bdff0b6ba2499ba4` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.717847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af82c99ccd584433bdff0b6ba2499ba4)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.719966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:09.720707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1106/2188] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:09 2022] POST /identity/v3/users => generated 286 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:09.721548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa706b-f852-41f7-ac2b-56f0801ae538 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.735069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa706b-f852-41f7-ac2b-56f0801ae538 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.741353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.742014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.742496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.742954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.743895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.745537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:09.780330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:09.786235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1107/2189] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:09 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:09.787481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.790500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:09.817159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af82c99ccd584433bdff0b6ba2499ba4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:09.829153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af82c99ccd584433bdff0b6ba2499ba4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:09.831160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af82c99ccd584433bdff0b6ba2499ba4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:09.832035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af82c99ccd584433bdff0b6ba2499ba4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:09.842992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af82c99ccd584433bdff0b6ba2499ba4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:09.867961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1083/2190] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:09 2022] DELETE /identity/v3/users/af82c99ccd584433bdff0b6ba2499ba4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:09.869161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:09.870534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:09.874353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86015-49ca-4a24-8d7c-2cc1d2c4ecbb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.952252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.952884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.953172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.953436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.957820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:09.986706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7907b-043b-4cc7-abec-1b6b9b661f3d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:09.993145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:09.993773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:09.994054 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:09.994334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:09.995015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:09.996624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.028628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1084/2191] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:10.029626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.031512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.053572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.055663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c645328-ac4e-4bf4-8d88-f5d14cae5585 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.056527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.067178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1108/2192] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:10.068295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2814bb-7c91-4668-ab78-fe0ada7f3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.068533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.070542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2814bb-7c91-4668-ab78-fe0ada7f3268 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.070857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2814bb-7c91-4668-ab78-fe0ada7f3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.071143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2814bb-7c91-4668-ab78-fe0ada7f3268 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.071790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2814bb-7c91-4668-ab78-fe0ada7f3268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.073791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2814bb-7c91-4668-ab78-fe0ada7f3268 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.081872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3492-aa5f-4435-96ef-a51348091ac9 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.090612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.091357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.092074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.092349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.093015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.099707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.111606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1085/2193] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:10 2022] POST /identity/v3/users => generated 294 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:10.116142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2814bb-7c91-4668-ab78-fe0ada7f3268 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.135216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2814bb-7c91-4668-ab78-fe0ada7f3268 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.141313 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1109/2194] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:10.146712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0096a0-fa65-4088-8d54-72ab1749242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.147216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.147864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0096a0-fa65-4088-8d54-72ab1749242c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.149618 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0096a0-fa65-4088-8d54-72ab1749242c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.150019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0096a0-fa65-4088-8d54-72ab1749242c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.150796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0096a0-fa65-4088-8d54-72ab1749242c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.156340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0096a0-fa65-4088-8d54-72ab1749242c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.158595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.180194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:10.187442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1086/2195] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:10.188316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0096a0-fa65-4088-8d54-72ab1749242c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.201597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd14e6-658d-426e-9e45-88367ee770a9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.213438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.215820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0096a0-fa65-4088-8d54-72ab1749242c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.217363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.219042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.220057 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] PATH_INFO: `/v3/projects/c282ec454ba64329ba7031fc1f90db20` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.226631 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0dd92-6ce1-4222-9350-c7f3b7bb1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.227663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c282ec454ba64329ba7031fc1f90db20)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.229606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.229720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0dd92-6ce1-4222-9350-c7f3b7bb1c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.229900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0dd92-6ce1-4222-9350-c7f3b7bb1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.230236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0dd92-6ce1-4222-9350-c7f3b7bb1c75 admin admin] PATH_INFO: `/v3/projects/cd6bb722d9b949e081c491ffeae2ba7e/users/35af5fb664c043faa62acf8e5be03c0a/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.266380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0dd92-6ce1-4222-9350-c7f3b7bb1c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6bb722d9b949e081c491ffeae2ba7e, user_id=35af5fb664c043faa62acf8e5be03c0a, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.272457 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0dd92-6ce1-4222-9350-c7f3b7bb1c75 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.306179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1087/2196] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:10 2022] PUT /identity/v3/projects/cd6bb722d9b949e081c491ffeae2ba7e/users/35af5fb664c043faa62acf8e5be03c0a/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:10.313188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0dd92-6ce1-4222-9350-c7f3b7bb1c75 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.362104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c282ec454ba64329ba7031fc1f90db20', 'request_id': 'req-2493b908-ee06-4cb6-83b2-e0b22f0627f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.378864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c282ec454ba64329ba7031fc1f90db20', 'request_id': 'req-2493b908-ee06-4cb6-83b2-e0b22f0627f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.395455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c282ec454ba64329ba7031fc1f90db20', 'request_id': 'req-2493b908-ee06-4cb6-83b2-e0b22f0627f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.416411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] The token cache is being invalidate because project c282ec454ba64329ba7031fc1f90db20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:10.416710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.420581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2493b908-ee06-4cb6-83b2-e0b22f0627f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.423944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1110/2197] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:10 2022] DELETE /identity/v3/projects/c282ec454ba64329ba7031fc1f90db20 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:10.424814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:10.430605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f39a5-ce4f-4705-a09a-3c7d3847e1cc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.431576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f39a5-ce4f-4705-a09a-3c7d3847e1cc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.431576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f39a5-ce4f-4705-a09a-3c7d3847e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.443659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0dd92-6ce1-4222-9350-c7f3b7bb1c75 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.480549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a54f39a5-ce4f-4705-a09a-3c7d3847e1cc None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:10.481960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a54f39a5-ce4f-4705-a09a-3c7d3847e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.538283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.541282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.541828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.543888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.545597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.548961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.567195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1088/2198] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:10.568686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.573175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.596886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1111/2199] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:10.599242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d4b5-f24a-4d4a-84d0-3728ec4e5952 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.599529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d4b5-f24a-4d4a-84d0-3728ec4e5952 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.599803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d4b5-f24a-4d4a-84d0-3728ec4e5952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.608733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0480-8764-47b0-8690-c10c0a9486df admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.615657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.616530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.618719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.620195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] PATH_INFO: `/v3/users/34023f8e08e64d0b93b306064fb7dc9b` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.621411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34023f8e08e64d0b93b306064fb7dc9b)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.624136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.625754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cd40d4b5-f24a-4d4a-84d0-3728ec4e5952 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:10.627971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd40d4b5-f24a-4d4a-84d0-3728ec4e5952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.638458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1112/2200] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:10.639808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40d4b5-f24a-4d4a-84d0-3728ec4e5952 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.644619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd40d4b5-f24a-4d4a-84d0-3728ec4e5952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.659974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40d4b5-f24a-4d4a-84d0-3728ec4e5952 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.668686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.669768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.670291 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.670842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] PATH_INFO: `/v3/projects/824c0391c2de42fb8088edddd978e9f7/users/738c73add60143f0b5dbdb279ebc47b7/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.692978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824c0391c2de42fb8088edddd978e9f7, user_id=738c73add60143f0b5dbdb279ebc47b7, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:10.702469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:10.712241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34023f8e08e64d0b93b306064fb7dc9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.729658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1113/2201] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:10 2022] PUT /identity/v3/projects/824c0391c2de42fb8088edddd978e9f7/users/738c73add60143f0b5dbdb279ebc47b7/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:10.730799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:10.732602 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.738984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34023f8e08e64d0b93b306064fb7dc9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.739911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34023f8e08e64d0b93b306064fb7dc9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.740556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34023f8e08e64d0b93b306064fb7dc9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.759619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fb9ee81e-aed2-496e-945f-a1cd154f7495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34023f8e08e64d0b93b306064fb7dc9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:10.796262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1089/2202] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:10 2022] DELETE /identity/v3/users/34023f8e08e64d0b93b306064fb7dc9b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:10.796262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333ee5-8bd6-4b2d-8e0f-3e2dcb7097c7 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.796262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333ee5-8bd6-4b2d-8e0f-3e2dcb7097c7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.796262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333ee5-8bd6-4b2d-8e0f-3e2dcb7097c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.840816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dbc88-435e-4549-a77a-7e07fdf65f83 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:10.841809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-00333ee5-8bd6-4b2d-8e0f-3e2dcb7097c7 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:10.843081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-00333ee5-8bd6-4b2d-8e0f-3e2dcb7097c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.866051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:10.955051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e80f-5a07-45cb-9e75-24332fd0d3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:10.956711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e80f-5a07-45cb-9e75-24332fd0d3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.957299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e80f-5a07-45cb-9e75-24332fd0d3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.957721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e80f-5a07-45cb-9e75-24332fd0d3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.959844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2027e80f-5a07-45cb-9e75-24332fd0d3f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:10.979328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1090/2203] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:10.980818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cf81a-ff24-4309-b562-3c691d707520 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:10.981228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cf81a-ff24-4309-b562-3c691d707520 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:10.981601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cf81a-ff24-4309-b562-3c691d707520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:10.994684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:11.068650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-de9cf81a-ff24-4309-b562-3c691d707520 None None] MFA Rules not processed for user `738c73add60143f0b5dbdb279ebc47b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:11.070474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-de9cf81a-ff24-4309-b562-3c691d707520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:11.092000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e80f-5a07-45cb-9e75-24332fd0d3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:11.093617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e80f-5a07-45cb-9e75-24332fd0d3f4 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:11.111478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1114/2204] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:11.123447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0e83-5a8d-4435-89c3-701b915b0615 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.125257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0e83-5a8d-4435-89c3-701b915b0615 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.126990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0e83-5a8d-4435-89c3-701b915b0615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.171227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dc8f0e83-5a8d-4435-89c3-701b915b0615 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:11.173445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dc8f0e83-5a8d-4435-89c3-701b915b0615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:11.184722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1115/2205] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:11.185896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f0e83-5a8d-4435-89c3-701b915b0615 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.199140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f0e83-5a8d-4435-89c3-701b915b0615 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:11.204990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:11.205759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1091/2206] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:11.206059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.206442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.207055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.208006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:11.208398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:11.210159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:11.210281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cf81a-ff24-4309-b562-3c691d707520 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.211805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-de9cf81a-ff24-4309-b562-3c691d707520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:11.230660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1116/2207] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:11.232181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.234541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:11.256844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dedc6-ff1f-4572-b2ee-d4bbd0ad919f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:11.265491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30ccbe-b013-47da-98b5-b7f1af95b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:11.266255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ccbe-b013-47da-98b5-b7f1af95b05a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.266532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ccbe-b013-47da-98b5-b7f1af95b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.266874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30ccbe-b013-47da-98b5-b7f1af95b05a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.267559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30ccbe-b013-47da-98b5-b7f1af95b05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:11.271059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30ccbe-b013-47da-98b5-b7f1af95b05a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:11.340472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1117/2208] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:11 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:11.342333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30ccbe-b013-47da-98b5-b7f1af95b05a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.359254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cf81a-ff24-4309-b562-3c691d707520 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:11.481705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:11.482338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.482620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.482921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.486171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:11.494628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30ccbe-b013-47da-98b5-b7f1af95b05a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:11.501782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:11.503256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.503745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.504826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.506321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:11.510069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:11.557655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1118/2209] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:11 2022] POST /identity/v3/projects => generated 389 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:11.558847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.562313 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:11.581250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:11.635720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:11.637165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:11.649563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:11.668607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b32a22-a202-4668-9a9d-81dedc835423 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:11.670115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1092/2210] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:11.671385 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.679404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ceb8a-45fd-415f-86aa-796ff4cad04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:11.681573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ceb8a-45fd-415f-86aa-796ff4cad04d service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.682160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ceb8a-45fd-415f-86aa-796ff4cad04d service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.683699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ceb8a-45fd-415f-86aa-796ff4cad04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.699698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f250a8-80ee-484f-8cd4-13406db54ac2 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:11.843354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ceb8a-45fd-415f-86aa-796ff4cad04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:11.843354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ceb8a-45fd-415f-86aa-796ff4cad04d service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:11.852228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1119/2211] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:11.854164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ceb8a-45fd-415f-86aa-796ff4cad04d service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.865926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ceb8a-45fd-415f-86aa-796ff4cad04d service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:11.880292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c31e-7de3-4fee-9aab-38561fca2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:11.882335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c31e-7de3-4fee-9aab-38561fca2363 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.884380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0815-0d36-493d-ba9b-39c84db0af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:11.885598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0815-0d36-493d-ba9b-39c84db0af68 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.886260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c31e-7de3-4fee-9aab-38561fca2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.887298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c31e-7de3-4fee-9aab-38561fca2363 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.887846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0815-0d36-493d-ba9b-39c84db0af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.889373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0815-0d36-493d-ba9b-39c84db0af68 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.891299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144c31e-7de3-4fee-9aab-38561fca2363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:11.892341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f0815-0d36-493d-ba9b-39c84db0af68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:11.895644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144c31e-7de3-4fee-9aab-38561fca2363 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:11.897261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f0815-0d36-493d-ba9b-39c84db0af68 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:11.944843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1093/2212] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:11 2022] POST /identity/v3/users => generated 300 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:11.948400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c31e-7de3-4fee-9aab-38561fca2363 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.971781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1120/2213] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:11 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:11.978029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c31e-7de3-4fee-9aab-38561fca2363 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:11.983627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0815-0d36-493d-ba9b-39c84db0af68 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:11.988934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e16e9-f13c-4494-ae17-d4b010637e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:11.989571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e16e9-f13c-4494-ae17-d4b010637e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:11.989851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e16e9-f13c-4494-ae17-d4b010637e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:11.990118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e16e9-f13c-4494-ae17-d4b010637e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:11.991373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e16e9-f13c-4494-ae17-d4b010637e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.000193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e16e9-f13c-4494-ae17-d4b010637e57 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:12.000892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0815-0d36-493d-ba9b-39c84db0af68 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:12.011030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde462b-34c5-40c1-8b20-b72c513aebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:12.013935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde462b-34c5-40c1-8b20-b72c513aebb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.014512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde462b-34c5-40c1-8b20-b72c513aebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.018298 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde462b-34c5-40c1-8b20-b72c513aebb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.019732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde462b-34c5-40c1-8b20-b72c513aebb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.022466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde462b-34c5-40c1-8b20-b72c513aebb4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:12.022671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1094/2214] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:12.027090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e16e9-f13c-4494-ae17-d4b010637e57 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:12.041036 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e16e9-f13c-4494-ae17-d4b010637e57 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:12.044391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1121/2215] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:12.049039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde462b-34c5-40c1-8b20-b72c513aebb4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:12.049693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a7012-bc6e-4ea8-a6fb-31231c095123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:12.050381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7012-bc6e-4ea8-a6fb-31231c095123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.050651 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7012-bc6e-4ea8-a6fb-31231c095123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.051067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7012-bc6e-4ea8-a6fb-31231c095123 admin admin] PATH_INFO: `/v3/projects/b160c95a98cc4746927bdd96c1387f2e/users/06d0a799417e4f86975c520d794a50b9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.073653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde462b-34c5-40c1-8b20-b72c513aebb4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:12.081244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a7012-bc6e-4ea8-a6fb-31231c095123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b160c95a98cc4746927bdd96c1387f2e, user_id=06d0a799417e4f86975c520d794a50b9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.084965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0bd13-ac67-4ad4-9522-4709ad5a3c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:12.085485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bd13-ac67-4ad4-9522-4709ad5a3c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.085760 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bd13-ac67-4ad4-9522-4709ad5a3c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.086240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bd13-ac67-4ad4-9522-4709ad5a3c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.087142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0bd13-ac67-4ad4-9522-4709ad5a3c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.088565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a7012-bc6e-4ea8-a6fb-31231c095123 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:12.088746 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0bd13-ac67-4ad4-9522-4709ad5a3c9c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:12.133906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1095/2216] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:12 2022] PUT /identity/v3/projects/b160c95a98cc4746927bdd96c1387f2e/users/06d0a799417e4f86975c520d794a50b9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:12.135326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1122/2217] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:02:12.138482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a7012-bc6e-4ea8-a6fb-31231c095123 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:12.138841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0bd13-ac67-4ad4-9522-4709ad5a3c9c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:12.161668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0bd13-ac67-4ad4-9522-4709ad5a3c9c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:12.295563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1cf2e-3813-4640-8244-fb44245861e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:12.296256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1cf2e-3813-4640-8244-fb44245861e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.296496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1cf2e-3813-4640-8244-fb44245861e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.296763 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1cf2e-3813-4640-8244-fb44245861e7 admin admin] PATH_INFO: `/v3/projects/e3df0f9883e740b0a17ac9931ecc9813/users/bfeaaa13b150405787bb0a7ca71ada40/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.309192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a7012-bc6e-4ea8-a6fb-31231c095123 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:12.315481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324bb1-3185-4eed-877a-6d33706bcea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:12.316053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1cf2e-3813-4640-8244-fb44245861e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3df0f9883e740b0a17ac9931ecc9813, user_id=bfeaaa13b150405787bb0a7ca71ada40, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.316469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324bb1-3185-4eed-877a-6d33706bcea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.316881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324bb1-3185-4eed-877a-6d33706bcea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.317324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324bb1-3185-4eed-877a-6d33706bcea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.318078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47324bb1-3185-4eed-877a-6d33706bcea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.319369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1cf2e-3813-4640-8244-fb44245861e7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:12.320572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47324bb1-3185-4eed-877a-6d33706bcea5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:12.334719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:12.339494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1096/2218] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:12.341041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1123/2219] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:12 2022] PUT /identity/v3/projects/e3df0f9883e740b0a17ac9931ecc9813/users/bfeaaa13b150405787bb0a7ca71ada40/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:12.343755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324bb1-3185-4eed-877a-6d33706bcea5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:12.348619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9938f-cc9d-49a7-849b-2244c05794aa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.350922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9938f-cc9d-49a7-849b-2244c05794aa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.351646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9938f-cc9d-49a7-849b-2244c05794aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.361140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324bb1-3185-4eed-877a-6d33706bcea5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:12.380076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e0b9938f-cc9d-49a7-849b-2244c05794aa None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:12.382494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e0b9938f-cc9d-49a7-849b-2244c05794aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:12.438275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:12.468623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1124/2220] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:02:12.473051 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57875e-d333-41ef-aab6-f0b5944733d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:12.474040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57875e-d333-41ef-aab6-f0b5944733d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.474837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57875e-d333-41ef-aab6-f0b5944733d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.475041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57875e-d333-41ef-aab6-f0b5944733d5 admin admin] PATH_INFO: `/v3/projects/b160c95a98cc4746927bdd96c1387f2e/users/06d0a799417e4f86975c520d794a50b9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.477617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57875e-d333-41ef-aab6-f0b5944733d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b160c95a98cc4746927bdd96c1387f2e, user_id=06d0a799417e4f86975c520d794a50b9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.481079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57875e-d333-41ef-aab6-f0b5944733d5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:12.492260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9938f-cc9d-49a7-849b-2244c05794aa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:12.500363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1097/2221] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:12 2022] PUT /identity/v3/projects/b160c95a98cc4746927bdd96c1387f2e/users/06d0a799417e4f86975c520d794a50b9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:12.512533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293116e-b43c-46dc-823e-d78dfc8cda35 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.513117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293116e-b43c-46dc-823e-d78dfc8cda35 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.514290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293116e-b43c-46dc-823e-d78dfc8cda35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.582455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9938f-cc9d-49a7-849b-2244c05794aa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:12.592959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1293116e-b43c-46dc-823e-d78dfc8cda35 None None] MFA Rules not processed for user `06d0a799417e4f86975c520d794a50b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:12.596867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1293116e-b43c-46dc-823e-d78dfc8cda35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:12.672734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2787dd7-0874-47e0-8c15-157205ce92ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:12.673358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787dd7-0874-47e0-8c15-157205ce92ed service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.673919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787dd7-0874-47e0-8c15-157205ce92ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.674120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787dd7-0874-47e0-8c15-157205ce92ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.776730 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2787dd7-0874-47e0-8c15-157205ce92ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.780345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2787dd7-0874-47e0-8c15-157205ce92ed service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:12.794820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1098/2222] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:12.796114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1125/2223] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:02:12.807971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293116e-b43c-46dc-823e-d78dfc8cda35 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:12.830525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f165601-c631-40d9-875b-ff6dcb3ab77b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.830868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f165601-c631-40d9-875b-ff6dcb3ab77b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.831105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f165601-c631-40d9-875b-ff6dcb3ab77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.863578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:12.906654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6f165601-c631-40d9-875b-ff6dcb3ab77b None None] MFA Rules not processed for user `35af5fb664c043faa62acf8e5be03c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:12.906654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6f165601-c631-40d9-875b-ff6dcb3ab77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:12.955450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293116e-b43c-46dc-823e-d78dfc8cda35 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:12.964402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1769b0-7dfd-4b34-a779-4faa7bcd3ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:12.965218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1769b0-7dfd-4b34-a779-4faa7bcd3ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:12.965567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1769b0-7dfd-4b34-a779-4faa7bcd3ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:12.965919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1769b0-7dfd-4b34-a779-4faa7bcd3ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:12.989961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1769b0-7dfd-4b34-a779-4faa7bcd3ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:12.998404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1769b0-7dfd-4b34-a779-4faa7bcd3ce4 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:13.028328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1099/2224] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:13.090780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1126/2225] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:13.103327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1769b0-7dfd-4b34-a779-4faa7bcd3ce4 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:13.108512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f165601-c631-40d9-875b-ff6dcb3ab77b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:13.111735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6f165601-c631-40d9-875b-ff6dcb3ab77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:13.116502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1769b0-7dfd-4b34-a779-4faa7bcd3ce4 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:13.121063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c9d0e-4c49-48bb-b0d3-0fcb75aff7c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:13.122670 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9d0e-4c49-48bb-b0d3-0fcb75aff7c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:13.123085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9d0e-4c49-48bb-b0d3-0fcb75aff7c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:13.123528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9d0e-4c49-48bb-b0d3-0fcb75aff7c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:13.135976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c9d0e-4c49-48bb-b0d3-0fcb75aff7c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:13.138008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f165601-c631-40d9-875b-ff6dcb3ab77b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:13.138486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c9d0e-4c49-48bb-b0d3-0fcb75aff7c5 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:13.144472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:13.145171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:13.145398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:13.145669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] PATH_INFO: `/v3/projects/a468e12ae5ac4ffc8c0134b8ba99f1cb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:13.149603 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a468e12ae5ac4ffc8c0134b8ba99f1cb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:13.151587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:13.162919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1100/2226] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:13.249267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a468e12ae5ac4ffc8c0134b8ba99f1cb', 'request_id': 'req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:13.262198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a468e12ae5ac4ffc8c0134b8ba99f1cb', 'request_id': 'req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:13.275942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a468e12ae5ac4ffc8c0134b8ba99f1cb', 'request_id': 'req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:13.302149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] The token cache is being invalidate because project a468e12ae5ac4ffc8c0134b8ba99f1cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:13.305301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:13.309245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31dcc17a-5077-4d5e-adf9-fcd8dd75c465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:13.311692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1127/2227] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:13 2022] DELETE /identity/v3/projects/a468e12ae5ac4ffc8c0134b8ba99f1cb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:13.316448 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2611-8665-4c91-9838-6b0aadc1fdda None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:13.317378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2611-8665-4c91-9838-6b0aadc1fdda None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:13.317671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2611-8665-4c91-9838-6b0aadc1fdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:13.364241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d51c2611-8665-4c91-9838-6b0aadc1fdda None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:13.367756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d51c2611-8665-4c91-9838-6b0aadc1fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:13.577266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:13.602163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1101/2228] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:13.605121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a5d5-611f-4f11-933a-24c751629d96 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:13.605327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a5d5-611f-4f11-933a-24c751629d96 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:13.607117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a5d5-611f-4f11-933a-24c751629d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:13.675490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a205a5d5-611f-4f11-933a-24c751629d96 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:13.677253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a205a5d5-611f-4f11-933a-24c751629d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:13.702472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1128/2229] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:13.706684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2611-8665-4c91-9838-6b0aadc1fdda None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:13.725161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2611-8665-4c91-9838-6b0aadc1fdda None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:13.757107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:13.758532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:13.764354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:13.764707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:13.765419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:13.765734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:13.775301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:13.807826 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1102/2230] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:13.817045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a5d5-611f-4f11-933a-24c751629d96 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:13.856940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a5d5-611f-4f11-933a-24c751629d96 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:13.876808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8118a-71ad-4baa-b638-6d7be3a4bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:13.877471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8118a-71ad-4baa-b638-6d7be3a4bb7c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:13.877790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8118a-71ad-4baa-b638-6d7be3a4bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:13.878060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8118a-71ad-4baa-b638-6d7be3a4bb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:13.878702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8118a-71ad-4baa-b638-6d7be3a4bb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:13.882202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8118a-71ad-4baa-b638-6d7be3a4bb7c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:13.987921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1129/2231] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:13 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:13.995552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:14.033682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5431a6b-6483-473d-8e6f-d7bbfa81a8a0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:14.181207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4f851-b765-4762-8c85-78b9828c994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:14.182002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f851-b765-4762-8c85-78b9828c994f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:14.182263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f851-b765-4762-8c85-78b9828c994f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:14.182532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f851-b765-4762-8c85-78b9828c994f admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:14.183209 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4f851-b765-4762-8c85-78b9828c994f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:14.185147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4f851-b765-4762-8c85-78b9828c994f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:14.235101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1103/2232] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:13 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:02:14.237898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8118a-71ad-4baa-b638-6d7be3a4bb7c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:14.250143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dbdff-8742-4874-aa96-10d9e4211d29 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:14.250427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dbdff-8742-4874-aa96-10d9e4211d29 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:14.250719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dbdff-8742-4874-aa96-10d9e4211d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:14.263734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8118a-71ad-4baa-b638-6d7be3a4bb7c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:14.269411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e8756-7077-477d-b67c-c194cc5caac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:14.270395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e8756-7077-477d-b67c-c194cc5caac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:14.270888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e8756-7077-477d-b67c-c194cc5caac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:14.271453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e8756-7077-477d-b67c-c194cc5caac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:14.272268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e8756-7077-477d-b67c-c194cc5caac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:14.274782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e8756-7077-477d-b67c-c194cc5caac1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:14.295901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1130/2233] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:14.306827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e8756-7077-477d-b67c-c194cc5caac1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:14.321050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e8756-7077-477d-b67c-c194cc5caac1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:14.328938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-794dbdff-8742-4874-aa96-10d9e4211d29 None None] MFA Rules not processed for user `08bef1ffe89540369203e69fcc06d52d`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:14.330888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-794dbdff-8742-4874-aa96-10d9e4211d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:14.331433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f2b51-51b6-401b-8055-d9b652354659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:14.332492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f2b51-51b6-401b-8055-d9b652354659 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:14.332956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f2b51-51b6-401b-8055-d9b652354659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:14.333791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f2b51-51b6-401b-8055-d9b652354659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:14.334855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f2b51-51b6-401b-8055-d9b652354659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:14.337826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f2b51-51b6-401b-8055-d9b652354659 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:14.374532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1131/2234] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:02:14.379245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f2b51-51b6-401b-8055-d9b652354659 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:14.399354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f2b51-51b6-401b-8055-d9b652354659 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:14.423625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779eb7b-2f9e-43bb-8fa7-bbab0c6613fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:14.424633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779eb7b-2f9e-43bb-8fa7-bbab0c6613fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:14.426499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779eb7b-2f9e-43bb-8fa7-bbab0c6613fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:14.427527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779eb7b-2f9e-43bb-8fa7-bbab0c6613fa admin admin] PATH_INFO: `/v3/projects/70af069a1c894951a01554026eaed57c/users/97604dd2eb8d445c8fe7bc49df08a9a3/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:14.468382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779eb7b-2f9e-43bb-8fa7-bbab0c6613fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=70af069a1c894951a01554026eaed57c, user_id=97604dd2eb8d445c8fe7bc49df08a9a3, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:14.471393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779eb7b-2f9e-43bb-8fa7-bbab0c6613fa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:14.474929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1104/2235] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:14.489878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dbdff-8742-4874-aa96-10d9e4211d29 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:14.493821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-794dbdff-8742-4874-aa96-10d9e4211d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:14.505933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1132/2236] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:14 2022] PUT /identity/v3/projects/70af069a1c894951a01554026eaed57c/users/97604dd2eb8d445c8fe7bc49df08a9a3/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:14.525702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781a1cc-4b82-4cd3-998e-31a7ebfca6a1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:14.526594 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781a1cc-4b82-4cd3-998e-31a7ebfca6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:14.527101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781a1cc-4b82-4cd3-998e-31a7ebfca6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:14.537981 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:14.577944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0781a1cc-4b82-4cd3-998e-31a7ebfca6a1 None None] MFA Rules not processed for user `97604dd2eb8d445c8fe7bc49df08a9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:14.582688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0781a1cc-4b82-4cd3-998e-31a7ebfca6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:14.695589 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:14.728589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1133/2237] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:14.729756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781a1cc-4b82-4cd3-998e-31a7ebfca6a1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:14.734893 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0781a1cc-4b82-4cd3-998e-31a7ebfca6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:14.778005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dbdff-8742-4874-aa96-10d9e4211d29 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:14.855536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781a1cc-4b82-4cd3-998e-31a7ebfca6a1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:14.860754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:14.862911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:14.863314 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:14.863786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:14.867629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:14.933880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5763d-eb18-486b-ab9a-c3c389a72aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:14.936879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5763d-eb18-486b-ab9a-c3c389a72aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:14.938072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5763d-eb18-486b-ab9a-c3c389a72aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:14.938941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5763d-eb18-486b-ab9a-c3c389a72aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:14.942920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9ad5763d-eb18-486b-ab9a-c3c389a72aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:14.981824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:14.983315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:15.006002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1134/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:15.012562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:15.026021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:15.122372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5763d-eb18-486b-ab9a-c3c389a72aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:15.131160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5763d-eb18-486b-ab9a-c3c389a72aa3 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:15.154944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1105/2239] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:15.159990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68b655-c363-4b5d-a5b9-3732dba2e8f8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:15.161821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68b655-c363-4b5d-a5b9-3732dba2e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:15.162447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68b655-c363-4b5d-a5b9-3732dba2e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:15.171712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:15.180601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a8490-52ef-4b07-b0f6-b18a342b0f21 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:15.191703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:15.192337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:15.192667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:15.192932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:15.213564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9b68b655-c363-4b5d-a5b9-3732dba2e8f8 None None] MFA Rules not processed for user `35af5fb664c043faa62acf8e5be03c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:15.216179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9b68b655-c363-4b5d-a5b9-3732dba2e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:15.220816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:15.222321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:15.240967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1135/2240] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:15.368117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1106/2241] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:17.046042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:17.048320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:17.258568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dadebf-5e7e-4be8-8f2d-72b95956103f service glance] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:17.270458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:17.271202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:17.275885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:17.276221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] PATH_INFO: `/v3/users/5c62b94ce9ee4017bb77c09cb784df24` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:17.279394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c62b94ce9ee4017bb77c09cb784df24)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:17.281698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:17.462558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c62b94ce9ee4017bb77c09cb784df24'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:17.504552 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c62b94ce9ee4017bb77c09cb784df24'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:17.518256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c62b94ce9ee4017bb77c09cb784df24'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:17.523744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c62b94ce9ee4017bb77c09cb784df24'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:17.546188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c62b94ce9ee4017bb77c09cb784df24'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:17.594113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1136/2242] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:17 2022] DELETE /identity/v3/users/5c62b94ce9ee4017bb77c09cb784df24 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:17.598919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502fb0-0e05-4c58-87ed-1c60a017afb1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:17.599762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502fb0-0e05-4c58-87ed-1c60a017afb1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:17.600337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502fb0-0e05-4c58-87ed-1c60a017afb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:17.642106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e8502fb0-0e05-4c58-87ed-1c60a017afb1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:17.666495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e8502fb0-0e05-4c58-87ed-1c60a017afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:17.802623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:17.874798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1107/2243] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:17.908530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:17.912770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:18.022869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a542a-589a-44bb-87f6-428854c10457 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:18.026511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:18.027272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:18.027547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:18.027816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:18.051506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:18.053158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:18.076660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1137/2244] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:19.057837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c979-cea8-4269-81d3-d74c6be2991d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:19.058858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c979-cea8-4269-81d3-d74c6be2991d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:19.059335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c979-cea8-4269-81d3-d74c6be2991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:19.151089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bbf8c979-cea8-4269-81d3-d74c6be2991d None None] MFA Rules not processed for user `89e9adac7ad241ee9081ab600342af9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:19.151089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bbf8c979-cea8-4269-81d3-d74c6be2991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:19.300077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1108/2245] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:20.163523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:20.166795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:20.192080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7daaa7-0397-4e45-8286-019c4de45fdd service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:20.209527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:20.217830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:20.218171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:20.218564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] PATH_INFO: `/v3/projects/bac91f42c503434f989cc174c6c16fd4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:20.221461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac91f42c503434f989cc174c6c16fd4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:20.223454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:20.287573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:20.522376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac91f42c503434f989cc174c6c16fd4', 'request_id': 'req-1528fbb5-003d-4131-9bcf-f256603a3fa9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:20.566771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac91f42c503434f989cc174c6c16fd4', 'request_id': 'req-1528fbb5-003d-4131-9bcf-f256603a3fa9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:20.600775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac91f42c503434f989cc174c6c16fd4', 'request_id': 'req-1528fbb5-003d-4131-9bcf-f256603a3fa9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:20.687751 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] The token cache is being invalidate because project bac91f42c503434f989cc174c6c16fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:20.688078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:20.708542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:20.715228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1138/2246] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:20 2022] DELETE /identity/v3/projects/bac91f42c503434f989cc174c6c16fd4 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:20.719339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8c979-cea8-4269-81d3-d74c6be2991d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:20.742234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8c979-cea8-4269-81d3-d74c6be2991d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:20.970143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:20.970821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:20.971106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:20.971428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] PATH_INFO: `/v3/users/4ba6642075d845f09ccfd1130981d4cb` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:20.974865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba6642075d845f09ccfd1130981d4cb)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:20.983283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:21.037061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:21.038536 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:21.147024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba6642075d845f09ccfd1130981d4cb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:21.167002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba6642075d845f09ccfd1130981d4cb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:21.167695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba6642075d845f09ccfd1130981d4cb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:21.168375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba6642075d845f09ccfd1130981d4cb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:21.183736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba6642075d845f09ccfd1130981d4cb'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:21.222478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528fbb5-003d-4131-9bcf-f256603a3fa9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:21.233854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:21.234773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:21.235201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:21.235617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:21.238682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:21.265089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1109/2247] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:20 2022] DELETE /identity/v3/users/4ba6642075d845f09ccfd1130981d4cb => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:21.371428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:21.373293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:21.419059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1139/2248] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:02:22.392908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:22.394616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:22.408666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:22.660472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03136-ae06-4e75-bc81-df5034187805 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:22.692056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:22.693848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:22.708017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:22.708367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] PATH_INFO: `/v3/projects/8db6b3aeffb14b69ac1d2f856f6432e0` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:22.709738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db6b3aeffb14b69ac1d2f856f6432e0)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:22.717190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:22.886034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db6b3aeffb14b69ac1d2f856f6432e0', 'request_id': 'req-681cd25a-83e1-4191-83c2-4a5f19b622b7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:22.931981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db6b3aeffb14b69ac1d2f856f6432e0', 'request_id': 'req-681cd25a-83e1-4191-83c2-4a5f19b622b7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:22.946847 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db6b3aeffb14b69ac1d2f856f6432e0', 'request_id': 'req-681cd25a-83e1-4191-83c2-4a5f19b622b7'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:22.973341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] The token cache is being invalidate because project 8db6b3aeffb14b69ac1d2f856f6432e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:22.973645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:22.978261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-681cd25a-83e1-4191-83c2-4a5f19b622b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:22.983987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1110/2249] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:22 2022] DELETE /identity/v3/projects/8db6b3aeffb14b69ac1d2f856f6432e0 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:22.986488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:23.010591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ba8f5-144d-45ec-a553-af81f125aa47 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:23.176982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:23.236539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:23.243327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:23.243608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:23.246034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] PATH_INFO: `/v3/users/191dadb5203c4f89bd8c59f3d3f4d2f2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:23.250164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191dadb5203c4f89bd8c59f3d3f4d2f2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:23.253096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:23.384785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191dadb5203c4f89bd8c59f3d3f4d2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:23.402648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191dadb5203c4f89bd8c59f3d3f4d2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:23.403631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191dadb5203c4f89bd8c59f3d3f4d2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:23.404889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191dadb5203c4f89bd8c59f3d3f4d2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:23.421180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191dadb5203c4f89bd8c59f3d3f4d2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:23.465605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1140/2250] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:22 2022] DELETE /identity/v3/users/191dadb5203c4f89bd8c59f3d3f4d2f2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:23.513001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f51e-8e7f-423f-b0cf-8f5e8acc63be None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:23.513979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f51e-8e7f-423f-b0cf-8f5e8acc63be None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:23.514505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f51e-8e7f-423f-b0cf-8f5e8acc63be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:23.586112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d9e6f51e-8e7f-423f-b0cf-8f5e8acc63be None None] MFA Rules not processed for user `bfeaaa13b150405787bb0a7ca71ada40`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:23.587980 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d9e6f51e-8e7f-423f-b0cf-8f5e8acc63be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:23.707968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1111/2251] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:02:23.723801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:23.726547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:23.865264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296aed-4a85-43cd-b42b-cc39873631a9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:23.874411 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:23.875248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:23.875597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:23.875923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:23.893840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:23.895830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:23.909465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1141/2252] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:23.958185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f51e-8e7f-423f-b0cf-8f5e8acc63be None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:23.961938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d9e6f51e-8e7f-423f-b0cf-8f5e8acc63be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:24.016081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:24.052652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:24.054174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:24.093270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f51e-8e7f-423f-b0cf-8f5e8acc63be None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:24.104748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:24.105782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:24.106232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:24.106705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] PATH_INFO: `/v3/projects/276b0fd422ef4f8b81981050a7fe22ab` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:24.109087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276b0fd422ef4f8b81981050a7fe22ab)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:24.111947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:24.218054 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:24.232202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276b0fd422ef4f8b81981050a7fe22ab', 'request_id': 'req-ca7717c2-abe7-4604-9417-928bed85de45'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.235189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1d80-4b6a-4e52-89b3-f82d4bee2153 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:24.242213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276b0fd422ef4f8b81981050a7fe22ab', 'request_id': 'req-ca7717c2-abe7-4604-9417-928bed85de45'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.263786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276b0fd422ef4f8b81981050a7fe22ab', 'request_id': 'req-ca7717c2-abe7-4604-9417-928bed85de45'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.322396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] The token cache is being invalidate because project 276b0fd422ef4f8b81981050a7fe22ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:24.324332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.325337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ca7717c2-abe7-4604-9417-928bed85de45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.329750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1112/2253] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:23 2022] DELETE /identity/v3/projects/276b0fd422ef4f8b81981050a7fe22ab => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:24.479142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:24.479803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:24.480076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:24.480521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] PATH_INFO: `/v3/users/2ef44dcb73964827a609be1a07a4b143` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:24.481904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef44dcb73964827a609be1a07a4b143)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:24.484345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:24.604008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef44dcb73964827a609be1a07a4b143'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.621669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef44dcb73964827a609be1a07a4b143'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.624535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef44dcb73964827a609be1a07a4b143'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.624535 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef44dcb73964827a609be1a07a4b143'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.649214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef44dcb73964827a609be1a07a4b143'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:24.687308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1142/2254] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:24 2022] DELETE /identity/v3/users/2ef44dcb73964827a609be1a07a4b143 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:24.693205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d76e-9ed3-4d76-b31b-4658cfe9f3cb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:24.693726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d76e-9ed3-4d76-b31b-4658cfe9f3cb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:24.693726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d76e-9ed3-4d76-b31b-4658cfe9f3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:24.724963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-38b0d76e-9ed3-4d76-b31b-4658cfe9f3cb None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:24.727169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-38b0d76e-9ed3-4d76-b31b-4658cfe9f3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:24.820816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1113/2255] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:24.833624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:24.836038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:24.941785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63496149-3b3d-4b4c-8f0c-dc7c486748c9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:24.946024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9b897-2947-4c44-8774-98a67291c97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:24.946646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9b897-2947-4c44-8774-98a67291c97d service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:24.947482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9b897-2947-4c44-8774-98a67291c97d service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:24.947482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9b897-2947-4c44-8774-98a67291c97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:24.962797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9b897-2947-4c44-8774-98a67291c97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:24.964236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9b897-2947-4c44-8774-98a67291c97d service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:24.975495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1143/2256] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:25.567099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0d76e-9ed3-4d76-b31b-4658cfe9f3cb None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:25.569206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-38b0d76e-9ed3-4d76-b31b-4658cfe9f3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:25.585316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0d76e-9ed3-4d76-b31b-4658cfe9f3cb None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:25.591322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:25.591968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:25.592248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:25.592953 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] PATH_INFO: `/v3/projects/6579c4c730d94d8a980fc5120eeb5e5b` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:25.594365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6579c4c730d94d8a980fc5120eeb5e5b)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:25.598214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:25.712154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6579c4c730d94d8a980fc5120eeb5e5b', 'request_id': 'req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.714717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:25.721532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6579c4c730d94d8a980fc5120eeb5e5b', 'request_id': 'req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.732635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6579c4c730d94d8a980fc5120eeb5e5b', 'request_id': 'req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.761176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] The token cache is being invalidate because project 6579c4c730d94d8a980fc5120eeb5e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:25.761549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.762675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7cad3f5b-cac2-4f88-b4c2-8144ba4c436b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.771372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9b897-2947-4c44-8774-98a67291c97d service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:25.777227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1114/2257] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:25 2022] DELETE /identity/v3/projects/6579c4c730d94d8a980fc5120eeb5e5b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:25.785987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9b897-2947-4c44-8774-98a67291c97d service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:25.817819 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:25.864235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:25.864950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:25.865178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:25.865401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] PATH_INFO: `/v3/users/738c73add60143f0b5dbdb279ebc47b7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:25.868341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738c73add60143f0b5dbdb279ebc47b7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:25.870297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:25.946860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738c73add60143f0b5dbdb279ebc47b7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.960340 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738c73add60143f0b5dbdb279ebc47b7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.961262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738c73add60143f0b5dbdb279ebc47b7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.962817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738c73add60143f0b5dbdb279ebc47b7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:25.978103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738c73add60143f0b5dbdb279ebc47b7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:26.031151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1144/2258] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:25 2022] DELETE /identity/v3/users/738c73add60143f0b5dbdb279ebc47b7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:26.418415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72276-1196-44a7-a559-c799b3fd4de5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:26.419005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72276-1196-44a7-a559-c799b3fd4de5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:26.419450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72276-1196-44a7-a559-c799b3fd4de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:26.440531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-25b72276-1196-44a7-a559-c799b3fd4de5 None None] MFA Rules not processed for user `bfeaaa13b150405787bb0a7ca71ada40`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:26.441753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-25b72276-1196-44a7-a559-c799b3fd4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:26.521300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1115/2259] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:26.760783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:26.762924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:26.843655 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c347b-fd9f-44bd-9be3-4912e3e389b3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:26.849538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:26.850181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:26.850460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:26.850716 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] PATH_INFO: `/v3/projects/824c0391c2de42fb8088edddd978e9f7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:26.852022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] RBAC: Authorizing `identity:delete_project(project_id=824c0391c2de42fb8088edddd978e9f7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:26.853886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:26.904516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:26.907767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824c0391c2de42fb8088edddd978e9f7', 'request_id': 'req-d799d463-6eda-4b6c-93e9-3625ae07712a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:26.916219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824c0391c2de42fb8088edddd978e9f7', 'request_id': 'req-d799d463-6eda-4b6c-93e9-3625ae07712a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:26.923883 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824c0391c2de42fb8088edddd978e9f7', 'request_id': 'req-d799d463-6eda-4b6c-93e9-3625ae07712a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:26.936443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] The token cache is being invalidate because project 824c0391c2de42fb8088edddd978e9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:26.936736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:26.937383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:26.939147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1145/2260] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:26 2022] DELETE /identity/v3/projects/824c0391c2de42fb8088edddd978e9f7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:26.942958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72276-1196-44a7-a559-c799b3fd4de5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:26.956291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72276-1196-44a7-a559-c799b3fd4de5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:27.019016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:27.019645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:27.019926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:27.020229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] PATH_INFO: `/v3/users/06d0a799417e4f86975c520d794a50b9` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:27.021353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d0a799417e4f86975c520d794a50b9)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:27.023427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:27.073895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d0a799417e4f86975c520d794a50b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.081958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d0a799417e4f86975c520d794a50b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.082681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d0a799417e4f86975c520d794a50b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.083420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d0a799417e4f86975c520d794a50b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.090764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-21fd5075-8cdb-4aa1-8ce1-f4d7b9148b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d0a799417e4f86975c520d794a50b9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.108671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1116/2261] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:26 2022] DELETE /identity/v3/users/06d0a799417e4f86975c520d794a50b9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:27.533538 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:27.535163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:27.552928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d463-6eda-4b6c-93e9-3625ae07712a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:27.672364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:27.673081 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:27.673446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:27.673786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] PATH_INFO: `/v3/projects/b160c95a98cc4746927bdd96c1387f2e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:27.675184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b160c95a98cc4746927bdd96c1387f2e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:27.677138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:27.735997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b160c95a98cc4746927bdd96c1387f2e', 'request_id': 'req-2aceade2-c6a0-4cbf-a45d-11376a46cb98'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.743604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b160c95a98cc4746927bdd96c1387f2e', 'request_id': 'req-2aceade2-c6a0-4cbf-a45d-11376a46cb98'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.759042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b160c95a98cc4746927bdd96c1387f2e', 'request_id': 'req-2aceade2-c6a0-4cbf-a45d-11376a46cb98'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.771620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] The token cache is being invalidate because project b160c95a98cc4746927bdd96c1387f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:27.772142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.772983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2aceade2-c6a0-4cbf-a45d-11376a46cb98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:27.775343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1146/2262] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:27 2022] DELETE /identity/v3/projects/b160c95a98cc4746927bdd96c1387f2e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:27.781488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94262-ddcc-4872-8de3-4a40ee48989e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:27.781836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94262-ddcc-4872-8de3-4a40ee48989e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:27.782180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94262-ddcc-4872-8de3-4a40ee48989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:27.791015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:27.806377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-47f94262-ddcc-4872-8de3-4a40ee48989e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:27.807970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-47f94262-ddcc-4872-8de3-4a40ee48989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:27.890953 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1117/2263] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:27.893659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5122-4efa-4f79-8e3b-857f932cf151 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:27.894122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5122-4efa-4f79-8e3b-857f932cf151 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:27.894324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5122-4efa-4f79-8e3b-857f932cf151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:27.916400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7e2a5122-4efa-4f79-8e3b-857f932cf151 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:27.917936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7e2a5122-4efa-4f79-8e3b-857f932cf151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:27.926326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1147/2264] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:02:27.930621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94262-ddcc-4872-8de3-4a40ee48989e None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:27.941088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94262-ddcc-4872-8de3-4a40ee48989e None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:27.946927 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:27.948187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:27.948658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:27.949073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:27.949905 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:27.950207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:27.951950 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:27.965822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1118/2265] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:27.970289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a5122-4efa-4f79-8e3b-857f932cf151 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:27.980067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a5122-4efa-4f79-8e3b-857f932cf151 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:27.985167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3acdc-72ba-4878-bf97-3760b5c23788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:27.985838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3acdc-72ba-4878-bf97-3760b5c23788 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:27.986184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3acdc-72ba-4878-bf97-3760b5c23788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:27.986548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3acdc-72ba-4878-bf97-3760b5c23788 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:27.987225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3acdc-72ba-4878-bf97-3760b5c23788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:27.989127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3acdc-72ba-4878-bf97-3760b5c23788 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.029025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1148/2266] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:27 2022] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:28.030263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.040736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0ce70-5f58-4238-9ea1-53d39cbf8677 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:28.105004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a012d-1e6e-44b1-8176-31c1bd8aec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:28.105649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a012d-1e6e-44b1-8176-31c1bd8aec90 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.105924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a012d-1e6e-44b1-8176-31c1bd8aec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.106193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a012d-1e6e-44b1-8176-31c1bd8aec90 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.106893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a012d-1e6e-44b1-8176-31c1bd8aec90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:28.108843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a012d-1e6e-44b1-8176-31c1bd8aec90 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.133066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1119/2267] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:28 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:28.138033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3acdc-72ba-4878-bf97-3760b5c23788 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.149283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3acdc-72ba-4878-bf97-3760b5c23788 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:28.154481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af25fd-86f4-4db3-b08e-361ab37a2a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:28.155189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af25fd-86f4-4db3-b08e-361ab37a2a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.155460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af25fd-86f4-4db3-b08e-361ab37a2a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.155765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af25fd-86f4-4db3-b08e-361ab37a2a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.156632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af25fd-86f4-4db3-b08e-361ab37a2a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:28.158414 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af25fd-86f4-4db3-b08e-361ab37a2a3f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.173126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1149/2268] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:28.174357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a012d-1e6e-44b1-8176-31c1bd8aec90 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.186500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a012d-1e6e-44b1-8176-31c1bd8aec90 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:28.191517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3aac1-7236-47f2-a84e-e7e4e0ce177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:28.192132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3aac1-7236-47f2-a84e-e7e4e0ce177a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.192409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3aac1-7236-47f2-a84e-e7e4e0ce177a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.192679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3aac1-7236-47f2-a84e-e7e4e0ce177a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.193321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3aac1-7236-47f2-a84e-e7e4e0ce177a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:28.196016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3aac1-7236-47f2-a84e-e7e4e0ce177a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.207264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1120/2269] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:28.211706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af25fd-86f4-4db3-b08e-361ab37a2a3f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.222010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af25fd-86f4-4db3-b08e-361ab37a2a3f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:28.226916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c1e4-d8d4-43d1-b903-7d515362baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:28.227563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c1e4-d8d4-43d1-b903-7d515362baf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.227854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c1e4-d8d4-43d1-b903-7d515362baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.228118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c1e4-d8d4-43d1-b903-7d515362baf6 admin admin] PATH_INFO: `/v3/projects/c735b6c0cd1842eb8e068c4f3723b6b9/users/45c45e2b15414a5ea817b03d7ae5b071/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.244307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6c1e4-d8d4-43d1-b903-7d515362baf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c735b6c0cd1842eb8e068c4f3723b6b9, user_id=45c45e2b15414a5ea817b03d7ae5b071, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:28.247349 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6c1e4-d8d4-43d1-b903-7d515362baf6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.260804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:28.270786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1150/2270] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:28 2022] PUT /identity/v3/projects/c735b6c0cd1842eb8e068c4f3723b6b9/users/45c45e2b15414a5ea817b03d7ae5b071/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:28.281972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f7b5-6fa3-4158-b7ff-f3e1f9f9e8b6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.282287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f7b5-6fa3-4158-b7ff-f3e1f9f9e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.282646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f7b5-6fa3-4158-b7ff-f3e1f9f9e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.316803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3331f7b5-6fa3-4158-b7ff-f3e1f9f9e8b6 None None] MFA Rules not processed for user `45c45e2b15414a5ea817b03d7ae5b071`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:28.318147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3331f7b5-6fa3-4158-b7ff-f3e1f9f9e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:28.409712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:28.421767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1121/2271] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:28.426791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c1e4-d8d4-43d1-b903-7d515362baf6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.515559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c1e4-d8d4-43d1-b903-7d515362baf6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:28.530948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e242d-9a54-4cd0-89f6-632a99f8b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:28.531942 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e242d-9a54-4cd0-89f6-632a99f8b0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.532231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e242d-9a54-4cd0-89f6-632a99f8b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.532696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e242d-9a54-4cd0-89f6-632a99f8b0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.534399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e242d-9a54-4cd0-89f6-632a99f8b0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:28.536789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e242d-9a54-4cd0-89f6-632a99f8b0b7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.583447 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1151/2272] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:28 2022] POST /identity/v3/projects => generated 399 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:28.587344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f7b5-6fa3-4158-b7ff-f3e1f9f9e8b6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.620322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f7b5-6fa3-4158-b7ff-f3e1f9f9e8b6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:28.788899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93274-6705-46ba-b2bb-aec309c9cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:28.789578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93274-6705-46ba-b2bb-aec309c9cbea admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.789855 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93274-6705-46ba-b2bb-aec309c9cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.790130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93274-6705-46ba-b2bb-aec309c9cbea admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.790796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93274-6705-46ba-b2bb-aec309c9cbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:28.792835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93274-6705-46ba-b2bb-aec309c9cbea admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.840110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1122/2273] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:28 2022] POST /identity/v3/users => generated 306 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:28.844128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e242d-9a54-4cd0-89f6-632a99f8b0b7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.854932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e242d-9a54-4cd0-89f6-632a99f8b0b7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:28.859855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e7d27-f666-4983-908c-b54a11a060b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:28.860557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e7d27-f666-4983-908c-b54a11a060b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.860757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e7d27-f666-4983-908c-b54a11a060b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.861052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e7d27-f666-4983-908c-b54a11a060b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.861657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e7d27-f666-4983-908c-b54a11a060b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:28.863527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e7d27-f666-4983-908c-b54a11a060b7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.882969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1152/2274] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:02:28.883733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93274-6705-46ba-b2bb-aec309c9cbea admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.897341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93274-6705-46ba-b2bb-aec309c9cbea admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:28.903969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fcc82-c6ea-43d8-bc93-185ab5ca159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:28.904626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fcc82-c6ea-43d8-bc93-185ab5ca159b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:28.904913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fcc82-c6ea-43d8-bc93-185ab5ca159b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:28.905188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fcc82-c6ea-43d8-bc93-185ab5ca159b admin admin] PATH_INFO: `/v3/projects/d7741ac72f124265b34758ec7da6f711/users/e273e4104abd4bb29b68e8be75be0d73/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:28.921731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fcc82-c6ea-43d8-bc93-185ab5ca159b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7741ac72f124265b34758ec7da6f711, user_id=e273e4104abd4bb29b68e8be75be0d73, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:28.924553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fcc82-c6ea-43d8-bc93-185ab5ca159b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:28.941441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1123/2275] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:28 2022] PUT /identity/v3/projects/d7741ac72f124265b34758ec7da6f711/users/e273e4104abd4bb29b68e8be75be0d73/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:28.945251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e7d27-f666-4983-908c-b54a11a060b7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:28.956416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e7d27-f666-4983-908c-b54a11a060b7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:29.033966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7f20-1a35-4018-9263-9e7741080c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:29.034509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7f20-1a35-4018-9263-9e7741080c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:29.034820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7f20-1a35-4018-9263-9e7741080c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:29.035096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7f20-1a35-4018-9263-9e7741080c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:29.038290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7f20-1a35-4018-9263-9e7741080c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:29.040177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7f20-1a35-4018-9263-9e7741080c25 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:29.051928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1153/2276] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:29.056877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fcc82-c6ea-43d8-bc93-185ab5ca159b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:29.068254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fcc82-c6ea-43d8-bc93-185ab5ca159b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:29.074943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:29.075696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:29.076040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:29.076706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] PATH_INFO: `/v3/projects/d7741ac72f124265b34758ec7da6f711/users/e273e4104abd4bb29b68e8be75be0d73/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:29.078409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7741ac72f124265b34758ec7da6f711, user_id=e273e4104abd4bb29b68e8be75be0d73, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:29.081239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:29.093692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1124/2277] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:29 2022] PUT /identity/v3/projects/d7741ac72f124265b34758ec7da6f711/users/e273e4104abd4bb29b68e8be75be0d73/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:29.105000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c99f-df75-4139-8c24-2db75acc6839 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:29.105286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c99f-df75-4139-8c24-2db75acc6839 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:29.105562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c99f-df75-4139-8c24-2db75acc6839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:29.151514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-06e1c99f-df75-4139-8c24-2db75acc6839 None None] MFA Rules not processed for user `e273e4104abd4bb29b68e8be75be0d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:29.152796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-06e1c99f-df75-4139-8c24-2db75acc6839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:29.232281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:29.244108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1154/2278] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:29 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:29.256557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:29.258786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:29.324243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24726f18-f71d-47f0-b1fb-b52b27c30ff1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:29.327936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a9140-3279-464c-a935-cea59935cba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:29.328561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a9140-3279-464c-a935-cea59935cba9 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:29.328837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a9140-3279-464c-a935-cea59935cba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:29.329105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a9140-3279-464c-a935-cea59935cba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:29.338561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a9140-3279-464c-a935-cea59935cba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:29.340043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a9140-3279-464c-a935-cea59935cba9 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:29.352701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1125/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:29.448978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1c99f-df75-4139-8c24-2db75acc6839 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:29.459690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1c99f-df75-4139-8c24-2db75acc6839 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:29.463721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c22d27-8c01-471c-a763-9efedf30b629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:29.464351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c22d27-8c01-471c-a763-9efedf30b629 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:29.464769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c22d27-8c01-471c-a763-9efedf30b629 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:29.464984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c22d27-8c01-471c-a763-9efedf30b629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:29.541440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c22d27-8c01-471c-a763-9efedf30b629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:29.544933 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c22d27-8c01-471c-a763-9efedf30b629 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:29.559739 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1155/2280] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:29 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:34.040488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a9140-3279-464c-a935-cea59935cba9 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:34.186891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:34.205148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a9140-3279-464c-a935-cea59935cba9 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:34.209933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:34.211330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:34.211607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:34.211874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] PATH_INFO: `/v3/users/45c45e2b15414a5ea817b03d7ae5b071` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:34.213008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c45e2b15414a5ea817b03d7ae5b071)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:34.214951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:34.263027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c45e2b15414a5ea817b03d7ae5b071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:34.271269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c45e2b15414a5ea817b03d7ae5b071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:34.272027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c45e2b15414a5ea817b03d7ae5b071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:34.274087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c45e2b15414a5ea817b03d7ae5b071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:34.281312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c45e2b15414a5ea817b03d7ae5b071'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:34.301414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1126/2281] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:34 2022] DELETE /identity/v3/users/45c45e2b15414a5ea817b03d7ae5b071 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:34.306256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb0a36-c0b3-40ab-a36f-88c220d1c0b5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:34.306745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb0a36-c0b3-40ab-a36f-88c220d1c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:34.306864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb0a36-c0b3-40ab-a36f-88c220d1c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:34.325990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cfeb0a36-c0b3-40ab-a36f-88c220d1c0b5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:34.327285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cfeb0a36-c0b3-40ab-a36f-88c220d1c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:34.393676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1156/2282] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:34.404154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:34.405660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:34.591126 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c1a5b-8d27-4ebc-b087-6f7a8f752ab2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:34.595762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2951-b740-47a5-85f7-0e2e89481258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:34.596376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2951-b740-47a5-85f7-0e2e89481258 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:34.596529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2951-b740-47a5-85f7-0e2e89481258 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:34.596805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2951-b740-47a5-85f7-0e2e89481258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:34.607995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec2951-b740-47a5-85f7-0e2e89481258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:34.609536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec2951-b740-47a5-85f7-0e2e89481258 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:34.622122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1127/2283] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:35.009439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb0a36-c0b3-40ab-a36f-88c220d1c0b5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:35.010802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cfeb0a36-c0b3-40ab-a36f-88c220d1c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:35.025087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb0a36-c0b3-40ab-a36f-88c220d1c0b5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:35.031573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:35.032384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:35.032753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:35.033069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] PATH_INFO: `/v3/projects/c735b6c0cd1842eb8e068c4f3723b6b9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:35.034906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c735b6c0cd1842eb8e068c4f3723b6b9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:35.037359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:35.130694 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c735b6c0cd1842eb8e068c4f3723b6b9', 'request_id': 'req-aaf93efa-c488-42fd-9300-21d131a8a3f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.139562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c735b6c0cd1842eb8e068c4f3723b6b9', 'request_id': 'req-aaf93efa-c488-42fd-9300-21d131a8a3f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.149698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c735b6c0cd1842eb8e068c4f3723b6b9', 'request_id': 'req-aaf93efa-c488-42fd-9300-21d131a8a3f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.168288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] The token cache is being invalidate because project c735b6c0cd1842eb8e068c4f3723b6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:35.168592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.170996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.173410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1157/2284] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:35 2022] DELETE /identity/v3/projects/c735b6c0cd1842eb8e068c4f3723b6b9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:35.176601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2951-b740-47a5-85f7-0e2e89481258 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:35.195164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2951-b740-47a5-85f7-0e2e89481258 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:35.309441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:35.310083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:35.310357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:35.310625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] PATH_INFO: `/v3/users/e273e4104abd4bb29b68e8be75be0d73` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:35.312012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e273e4104abd4bb29b68e8be75be0d73)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:35.314066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:35.336594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:35.392508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e273e4104abd4bb29b68e8be75be0d73'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.402347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e273e4104abd4bb29b68e8be75be0d73'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.403235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e273e4104abd4bb29b68e8be75be0d73'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.403945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e273e4104abd4bb29b68e8be75be0d73'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.414019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-cd0af75b-4e6d-4146-96e8-4c23650de32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e273e4104abd4bb29b68e8be75be0d73'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:35.489249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1128/2285] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:35 2022] DELETE /identity/v3/users/e273e4104abd4bb29b68e8be75be0d73 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:36.021896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:36.024951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:36.049141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93efa-c488-42fd-9300-21d131a8a3f0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:36.067119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:36.206723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:36.207809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.208633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.209126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] PATH_INFO: `/v3/projects/d7741ac72f124265b34758ec7da6f711` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.211649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7741ac72f124265b34758ec7da6f711)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:36.214977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:36.302854 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7741ac72f124265b34758ec7da6f711', 'request_id': 'req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:36.311620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7741ac72f124265b34758ec7da6f711', 'request_id': 'req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:36.336160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7741ac72f124265b34758ec7da6f711', 'request_id': 'req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:36.353505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] The token cache is being invalidate because project d7741ac72f124265b34758ec7da6f711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:36.353976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:36.354867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e360b88-26f3-49f5-ada8-ebc7a2f38b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:36.356953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1158/2286] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:36 2022] DELETE /identity/v3/projects/d7741ac72f124265b34758ec7da6f711 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:36.361838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f2aa8-3a50-4db5-a610-ca4ccd185a74 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.362771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f2aa8-3a50-4db5-a610-ca4ccd185a74 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.363110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f2aa8-3a50-4db5-a610-ca4ccd185a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.385203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d22f2aa8-3a50-4db5-a610-ca4ccd185a74 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:36.386558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d22f2aa8-3a50-4db5-a610-ca4ccd185a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:36.451413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1129/2287] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:36.458953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8fb96-9a5d-4359-ac5c-122add26327b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.459347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8fb96-9a5d-4359-ac5c-122add26327b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.459585 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8fb96-9a5d-4359-ac5c-122add26327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.486843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7af8fb96-9a5d-4359-ac5c-122add26327b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:36.488312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7af8fb96-9a5d-4359-ac5c-122add26327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:36.497240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1159/2288] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:36.501466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f2aa8-3a50-4db5-a610-ca4ccd185a74 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:36.514957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f2aa8-3a50-4db5-a610-ca4ccd185a74 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:36.520738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:36.521422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.521742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.522035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.522709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:36.523049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:36.524641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:36.536422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1130/2289] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:02:36.540807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8fb96-9a5d-4359-ac5c-122add26327b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:36.549925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8fb96-9a5d-4359-ac5c-122add26327b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:36.555997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5f69c-9d03-4def-a7bc-bc87c0304d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:36.556610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f69c-9d03-4def-a7bc-bc87c0304d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.556885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f69c-9d03-4def-a7bc-bc87c0304d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.557177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f69c-9d03-4def-a7bc-bc87c0304d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.557809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5f69c-9d03-4def-a7bc-bc87c0304d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:36.559732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5f69c-9d03-4def-a7bc-bc87c0304d6f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:36.594159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1160/2290] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:36 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:36.595309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:36.607217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801f011-c984-4afb-8bf6-1110e672ba21 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:36.680870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6e38a-92a2-442e-a6a3-a125866a112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:36.681512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e38a-92a2-442e-a6a3-a125866a112a admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.681785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e38a-92a2-442e-a6a3-a125866a112a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.682049 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e38a-92a2-442e-a6a3-a125866a112a admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.682689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6e38a-92a2-442e-a6a3-a125866a112a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:36.684745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6e38a-92a2-442e-a6a3-a125866a112a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:36.709459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1131/2291] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:36 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:36.713558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5f69c-9d03-4def-a7bc-bc87c0304d6f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:36.725448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5f69c-9d03-4def-a7bc-bc87c0304d6f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:36.732298 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7d4f0-0477-40e3-8e20-26963bcaf2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:36.733249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d4f0-0477-40e3-8e20-26963bcaf2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.733821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d4f0-0477-40e3-8e20-26963bcaf2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.734296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d4f0-0477-40e3-8e20-26963bcaf2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.735233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d4f0-0477-40e3-8e20-26963bcaf2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:36.737239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d4f0-0477-40e3-8e20-26963bcaf2fa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:36.749813 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1161/2292] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:36.753684 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6e38a-92a2-442e-a6a3-a125866a112a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:36.764675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6e38a-92a2-442e-a6a3-a125866a112a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:36.770788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12480c7-1d48-4c56-a505-04c2d8c27f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:36.770788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12480c7-1d48-4c56-a505-04c2d8c27f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.770788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12480c7-1d48-4c56-a505-04c2d8c27f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.770788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12480c7-1d48-4c56-a505-04c2d8c27f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.771187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12480c7-1d48-4c56-a505-04c2d8c27f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:36.772771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12480c7-1d48-4c56-a505-04c2d8c27f6a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:36.778278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:36.786743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1132/2293] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:36.790261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7d4f0-0477-40e3-8e20-26963bcaf2fa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:36.800879 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7d4f0-0477-40e3-8e20-26963bcaf2fa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:36.808480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a64b9-a5b9-4b88-abcf-b5ba7a815c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:36.809213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a64b9-a5b9-4b88-abcf-b5ba7a815c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.809521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a64b9-a5b9-4b88-abcf-b5ba7a815c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.809797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a64b9-a5b9-4b88-abcf-b5ba7a815c40 admin admin] PATH_INFO: `/v3/projects/9d396827c1fc4965bf84c54847253c9d/users/1e277e88e815444d811ba05d5b4641c2/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.826642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a64b9-a5b9-4b88-abcf-b5ba7a815c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d396827c1fc4965bf84c54847253c9d, user_id=1e277e88e815444d811ba05d5b4641c2, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:36.829351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a64b9-a5b9-4b88-abcf-b5ba7a815c40 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:36.842473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1162/2294] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:36 2022] PUT /identity/v3/projects/9d396827c1fc4965bf84c54847253c9d/users/1e277e88e815444d811ba05d5b4641c2/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:36.853367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42121a45-ee62-48ab-8450-2922f98662cf None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:36.853651 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42121a45-ee62-48ab-8450-2922f98662cf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:36.853948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42121a45-ee62-48ab-8450-2922f98662cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:36.884246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-42121a45-ee62-48ab-8450-2922f98662cf None None] MFA Rules not processed for user `1e277e88e815444d811ba05d5b4641c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:36.885586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-42121a45-ee62-48ab-8450-2922f98662cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:36.953730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1133/2295] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:36.958426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a64b9-a5b9-4b88-abcf-b5ba7a815c40 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:37.017004 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:37.035489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a64b9-a5b9-4b88-abcf-b5ba7a815c40 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:37.040274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1909-e83f-4806-8042-a3ecaebfa1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:37.040808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1909-e83f-4806-8042-a3ecaebfa1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:37.041080 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1909-e83f-4806-8042-a3ecaebfa1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:37.041347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1909-e83f-4806-8042-a3ecaebfa1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:37.041964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e1909-e83f-4806-8042-a3ecaebfa1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:37.043934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e1909-e83f-4806-8042-a3ecaebfa1c0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:37.076066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1163/2296] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:36 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:37.077965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42121a45-ee62-48ab-8450-2922f98662cf None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:37.090470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42121a45-ee62-48ab-8450-2922f98662cf None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:37.154293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e58c6-16fb-459e-8f60-814115dc7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:37.154918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e58c6-16fb-459e-8f60-814115dc7611 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:37.155217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e58c6-16fb-459e-8f60-814115dc7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:37.155504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e58c6-16fb-459e-8f60-814115dc7611 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:37.156147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e58c6-16fb-459e-8f60-814115dc7611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:37.158147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e58c6-16fb-459e-8f60-814115dc7611 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:37.181216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1134/2297] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:37 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:37.185355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1909-e83f-4806-8042-a3ecaebfa1c0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:37.197131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1909-e83f-4806-8042-a3ecaebfa1c0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:37.201578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7547dc-7584-4215-bd7e-f7ffc9b09aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:37.202166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7547dc-7584-4215-bd7e-f7ffc9b09aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:37.202439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7547dc-7584-4215-bd7e-f7ffc9b09aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:37.202704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7547dc-7584-4215-bd7e-f7ffc9b09aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:37.203359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7547dc-7584-4215-bd7e-f7ffc9b09aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:37.204934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7547dc-7584-4215-bd7e-f7ffc9b09aeb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:37.215935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1164/2298] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:02:37.220233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e58c6-16fb-459e-8f60-814115dc7611 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:37.231480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e58c6-16fb-459e-8f60-814115dc7611 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:37.236132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecacd9-b7df-4512-b4e9-ff56d3000d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:37.238302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecacd9-b7df-4512-b4e9-ff56d3000d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:37.238736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecacd9-b7df-4512-b4e9-ff56d3000d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:37.239048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecacd9-b7df-4512-b4e9-ff56d3000d38 admin admin] PATH_INFO: `/v3/projects/8efc5f9c75204f9b8212d0b43093e880/users/9b554a09919f4986afcceb361f64220c/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:37.254551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecacd9-b7df-4512-b4e9-ff56d3000d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efc5f9c75204f9b8212d0b43093e880, user_id=9b554a09919f4986afcceb361f64220c, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:37.257276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecacd9-b7df-4512-b4e9-ff56d3000d38 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:37.270421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1135/2299] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:37 2022] PUT /identity/v3/projects/8efc5f9c75204f9b8212d0b43093e880/users/9b554a09919f4986afcceb361f64220c/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:37.275312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7547dc-7584-4215-bd7e-f7ffc9b09aeb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:37.286835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7547dc-7584-4215-bd7e-f7ffc9b09aeb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:37.351013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3408-fd97-4563-8e6e-f96464f2c024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:37.351530 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3408-fd97-4563-8e6e-f96464f2c024 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:37.351808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3408-fd97-4563-8e6e-f96464f2c024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:37.352078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3408-fd97-4563-8e6e-f96464f2c024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:37.352712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3408-fd97-4563-8e6e-f96464f2c024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:37.354288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3408-fd97-4563-8e6e-f96464f2c024 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:37.364361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1165/2300] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:37.369313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecacd9-b7df-4512-b4e9-ff56d3000d38 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:37.380011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecacd9-b7df-4512-b4e9-ff56d3000d38 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:37.387600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:37.388281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:37.388596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:37.388892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] PATH_INFO: `/v3/projects/8efc5f9c75204f9b8212d0b43093e880/users/9b554a09919f4986afcceb361f64220c/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:37.390943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efc5f9c75204f9b8212d0b43093e880, user_id=9b554a09919f4986afcceb361f64220c, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:37.393635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:37.408091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1136/2301] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:37 2022] PUT /identity/v3/projects/8efc5f9c75204f9b8212d0b43093e880/users/9b554a09919f4986afcceb361f64220c/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:37.419947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8403f-9fe5-45bf-bc91-f0803dfe8a60 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:37.420259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8403f-9fe5-45bf-bc91-f0803dfe8a60 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:37.420516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8403f-9fe5-45bf-bc91-f0803dfe8a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:37.457475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-12f8403f-9fe5-45bf-bc91-f0803dfe8a60 None None] MFA Rules not processed for user `9b554a09919f4986afcceb361f64220c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:37.458701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-12f8403f-9fe5-45bf-bc91-f0803dfe8a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:37.564946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1166/2302] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:37.579749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:37.582470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:37.642255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:37.675360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96e75-3cc3-46ae-b185-2d1d5ad435a0 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:37.680070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169cb62-a6ce-4ae6-b21c-a26d3e057903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:37.680671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169cb62-a6ce-4ae6-b21c-a26d3e057903 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:37.680948 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169cb62-a6ce-4ae6-b21c-a26d3e057903 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:37.681215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169cb62-a6ce-4ae6-b21c-a26d3e057903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:37.690640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169cb62-a6ce-4ae6-b21c-a26d3e057903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:37.692111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169cb62-a6ce-4ae6-b21c-a26d3e057903 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:37.702348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1137/2303] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:38.451186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8403f-9fe5-45bf-bc91-f0803dfe8a60 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:38.513099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:38.545894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8403f-9fe5-45bf-bc91-f0803dfe8a60 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:38.551410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:38.552029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:38.552475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:38.552752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] PATH_INFO: `/v3/users/1e277e88e815444d811ba05d5b4641c2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:38.555421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e277e88e815444d811ba05d5b4641c2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:38.558257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:38.663757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e277e88e815444d811ba05d5b4641c2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:38.678255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e277e88e815444d811ba05d5b4641c2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:38.679224 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e277e88e815444d811ba05d5b4641c2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:38.680104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e277e88e815444d811ba05d5b4641c2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:38.702558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e277e88e815444d811ba05d5b4641c2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:38.736600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1167/2304] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:38 2022] DELETE /identity/v3/users/1e277e88e815444d811ba05d5b4641c2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:38.738837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3567d-bbda-46b1-b891-be432eb7e7a5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:38.739289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3567d-bbda-46b1-b891-be432eb7e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:38.739401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3567d-bbda-46b1-b891-be432eb7e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:38.769069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4ba3567d-bbda-46b1-b891-be432eb7e7a5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:38.770515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4ba3567d-bbda-46b1-b891-be432eb7e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:38.852491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1138/2305] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:38.867228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:38.869225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:38.961032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4be9-461c-4572-903e-a8e8b2431012 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:38.967000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7dde1-0b00-42f6-aef7-15ecc59c404f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:38.967954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dde1-0b00-42f6-aef7-15ecc59c404f service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:38.968437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dde1-0b00-42f6-aef7-15ecc59c404f service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:38.968885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dde1-0b00-42f6-aef7-15ecc59c404f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:38.982868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7dde1-0b00-42f6-aef7-15ecc59c404f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:38.984398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7dde1-0b00-42f6-aef7-15ecc59c404f service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:39.002657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1168/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:02:39.404112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3567d-bbda-46b1-b891-be432eb7e7a5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:39.409160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4ba3567d-bbda-46b1-b891-be432eb7e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:39.427276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3567d-bbda-46b1-b891-be432eb7e7a5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:39.447809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:39.448531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:39.448866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:39.449196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] PATH_INFO: `/v3/projects/9d396827c1fc4965bf84c54847253c9d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:39.450371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d396827c1fc4965bf84c54847253c9d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:39.452455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:39.501833 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d396827c1fc4965bf84c54847253c9d', 'request_id': 'req-6a8edaaf-55e2-47f9-b29f-284083d3f66b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.507576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d396827c1fc4965bf84c54847253c9d', 'request_id': 'req-6a8edaaf-55e2-47f9-b29f-284083d3f66b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.515488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d396827c1fc4965bf84c54847253c9d', 'request_id': 'req-6a8edaaf-55e2-47f9-b29f-284083d3f66b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.528270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] The token cache is being invalidate because project 9d396827c1fc4965bf84c54847253c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:39.528564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.529399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.531270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1139/2307] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:39 2022] DELETE /identity/v3/projects/9d396827c1fc4965bf84c54847253c9d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:39.536355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7dde1-0b00-42f6-aef7-15ecc59c404f service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:39.547640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7dde1-0b00-42f6-aef7-15ecc59c404f service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:39.605225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:39.605845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:39.606124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:39.606396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] PATH_INFO: `/v3/users/9b554a09919f4986afcceb361f64220c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:39.607540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b554a09919f4986afcceb361f64220c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:39.609433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:39.611674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:39.658428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b554a09919f4986afcceb361f64220c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.666319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b554a09919f4986afcceb361f64220c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.666943 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b554a09919f4986afcceb361f64220c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.667571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b554a09919f4986afcceb361f64220c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.674859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-230ea3b2-c60d-439b-aca3-b56dc8370405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b554a09919f4986afcceb361f64220c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:39.693543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1169/2308] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:39 2022] DELETE /identity/v3/users/9b554a09919f4986afcceb361f64220c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:40.038874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:40.041943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:40.060459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8edaaf-55e2-47f9-b29f-284083d3f66b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:40.141681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:40.142655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.142954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.143378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] PATH_INFO: `/v3/projects/8efc5f9c75204f9b8212d0b43093e880` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.144605 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efc5f9c75204f9b8212d0b43093e880)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:40.146606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:40.158646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:40.205647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efc5f9c75204f9b8212d0b43093e880', 'request_id': 'req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:40.211587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efc5f9c75204f9b8212d0b43093e880', 'request_id': 'req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:40.220081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efc5f9c75204f9b8212d0b43093e880', 'request_id': 'req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:40.232999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] The token cache is being invalidate because project 8efc5f9c75204f9b8212d0b43093e880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:40.233375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:40.234088 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1ff74ca7-f3fe-4d2d-a7a6-ae6f1c296a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:40.235657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1140/2309] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:40 2022] DELETE /identity/v3/projects/8efc5f9c75204f9b8212d0b43093e880 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:40.241882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f5b2b-0f53-497f-9ae1-56910a94b611 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.242417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f5b2b-0f53-497f-9ae1-56910a94b611 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.242684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f5b2b-0f53-497f-9ae1-56910a94b611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.264348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8d7f5b2b-0f53-497f-9ae1-56910a94b611 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:40.265586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d7f5b2b-0f53-497f-9ae1-56910a94b611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:40.334791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1170/2310] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:40.342937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539aff-a7ce-4b51-b6e1-def353753b32 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.343220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539aff-a7ce-4b51-b6e1-def353753b32 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.343490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c539aff-a7ce-4b51-b6e1-def353753b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.367837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3c539aff-a7ce-4b51-b6e1-def353753b32 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:40.369053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3c539aff-a7ce-4b51-b6e1-def353753b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:40.395630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1141/2311] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:40.402210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f5b2b-0f53-497f-9ae1-56910a94b611 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:40.412360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f5b2b-0f53-497f-9ae1-56910a94b611 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:40.418282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:40.419239 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.419462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.419742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.420493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:40.420794 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:40.422372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:40.443162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1171/2312] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:40.466489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c539aff-a7ce-4b51-b6e1-def353753b32 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:40.477387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c539aff-a7ce-4b51-b6e1-def353753b32 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:40.482557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c5805-c0f8-4c9b-9b57-b77325349ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:40.483225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c5805-c0f8-4c9b-9b57-b77325349ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.483586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c5805-c0f8-4c9b-9b57-b77325349ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.483873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c5805-c0f8-4c9b-9b57-b77325349ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.484545 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c5805-c0f8-4c9b-9b57-b77325349ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:40.486585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c5805-c0f8-4c9b-9b57-b77325349ea3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:40.539943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1142/2313] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:40 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:40.545303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:40.558050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c0dd-fba4-4c77-9508-85492ca29eae admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:40.642318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f84989-c2ba-4b86-b3e9-2c73854ee205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:40.643056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f84989-c2ba-4b86-b3e9-2c73854ee205 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.643399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f84989-c2ba-4b86-b3e9-2c73854ee205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.643860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f84989-c2ba-4b86-b3e9-2c73854ee205 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.644772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f84989-c2ba-4b86-b3e9-2c73854ee205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:40.647024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f84989-c2ba-4b86-b3e9-2c73854ee205 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:40.675709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:40.684795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1172/2314] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:40 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:02:40.688489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c5805-c0f8-4c9b-9b57-b77325349ea3 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:40.700788 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c5805-c0f8-4c9b-9b57-b77325349ea3 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:40.705596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd9a1-f286-478c-aeae-44c14de413f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:40.706194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd9a1-f286-478c-aeae-44c14de413f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.706465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd9a1-f286-478c-aeae-44c14de413f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.706732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd9a1-f286-478c-aeae-44c14de413f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.707395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd9a1-f286-478c-aeae-44c14de413f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:40.708968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd9a1-f286-478c-aeae-44c14de413f2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:40.719177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1143/2315] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:40.723675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f84989-c2ba-4b86-b3e9-2c73854ee205 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:40.735182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f84989-c2ba-4b86-b3e9-2c73854ee205 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:40.740565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986b70b-6ab1-41d1-b96c-1769e1cd82a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:40.742371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b70b-6ab1-41d1-b96c-1769e1cd82a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.742867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b70b-6ab1-41d1-b96c-1769e1cd82a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.743350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b70b-6ab1-41d1-b96c-1769e1cd82a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.744433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986b70b-6ab1-41d1-b96c-1769e1cd82a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:40.747303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986b70b-6ab1-41d1-b96c-1769e1cd82a9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:40.766056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1173/2316] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:02:40.766175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd9a1-f286-478c-aeae-44c14de413f2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:40.777046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd9a1-f286-478c-aeae-44c14de413f2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:40.782404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:40.783084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.783356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.783623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] PATH_INFO: `/v3/projects/05ab35c2d3124e869790d9a69108c0ea/users/712d91c6dee74b0da708a2fc40784e24/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.798252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ab35c2d3124e869790d9a69108c0ea, user_id=712d91c6dee74b0da708a2fc40784e24, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:40.800858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:40.813906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1144/2317] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:40 2022] PUT /identity/v3/projects/05ab35c2d3124e869790d9a69108c0ea/users/712d91c6dee74b0da708a2fc40784e24/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:40.825000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edadd5b-53d7-4dcb-ae5a-2d8e4714fc66 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.825284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edadd5b-53d7-4dcb-ae5a-2d8e4714fc66 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.825554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edadd5b-53d7-4dcb-ae5a-2d8e4714fc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:40.853100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5edadd5b-53d7-4dcb-ae5a-2d8e4714fc66 None None] MFA Rules not processed for user `712d91c6dee74b0da708a2fc40784e24`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:40.854307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5edadd5b-53d7-4dcb-ae5a-2d8e4714fc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:40.917721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1174/2318] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:40.929378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:40.931058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:40.986320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e29439-7b25-49d9-92f0-adbc81ba61fc admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:40.990129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:40.990719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:40.991031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:40.991835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:41.000815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:41.002512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:41.013167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1145/2319] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:41.034096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb49ed-9458-4b86-92dd-c4afcbc597f9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:41.034457 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb49ed-9458-4b86-92dd-c4afcbc597f9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:41.034830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb49ed-9458-4b86-92dd-c4afcbc597f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:41.054522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-28bb49ed-9458-4b86-92dd-c4afcbc597f9 None None] MFA Rules not processed for user `35af5fb664c043faa62acf8e5be03c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:41.055762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-28bb49ed-9458-4b86-92dd-c4afcbc597f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:41.114951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1175/2320] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:45.926028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:45.930154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:45.982423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:46.009821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10636096-3908-4f1e-bf34-cf781c2e2ce4 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:46.015248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:46.015879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:46.016155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:46.016420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] PATH_INFO: `/v3/users/97604dd2eb8d445c8fe7bc49df08a9a3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:46.017551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97604dd2eb8d445c8fe7bc49df08a9a3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:46.019500 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:46.068889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97604dd2eb8d445c8fe7bc49df08a9a3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.077355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97604dd2eb8d445c8fe7bc49df08a9a3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.077994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97604dd2eb8d445c8fe7bc49df08a9a3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.078600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97604dd2eb8d445c8fe7bc49df08a9a3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.086409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97604dd2eb8d445c8fe7bc49df08a9a3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.104047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1146/2321] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:45 2022] DELETE /identity/v3/users/97604dd2eb8d445c8fe7bc49df08a9a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:46.108270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455cf40-56ef-4b0e-b534-dbd3f17d2fb3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:46.109993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455cf40-56ef-4b0e-b534-dbd3f17d2fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:46.110437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455cf40-56ef-4b0e-b534-dbd3f17d2fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:46.140806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b455cf40-56ef-4b0e-b534-dbd3f17d2fb3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:46.142293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b455cf40-56ef-4b0e-b534-dbd3f17d2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:46.208614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1176/2322] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:46.219320 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:46.220800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:46.289263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64f22-e48d-462a-b3ee-45fc0ecbf68a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:46.293552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc6e49-2678-4212-9138-91d2fd534161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:46.293774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc6e49-2678-4212-9138-91d2fd534161 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:46.294055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc6e49-2678-4212-9138-91d2fd534161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:46.294404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc6e49-2678-4212-9138-91d2fd534161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:46.306102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc6e49-2678-4212-9138-91d2fd534161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:46.307685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc6e49-2678-4212-9138-91d2fd534161 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:46.319820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1147/2323] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:46.743997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455cf40-56ef-4b0e-b534-dbd3f17d2fb3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:46.745622 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b455cf40-56ef-4b0e-b534-dbd3f17d2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:46.787326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455cf40-56ef-4b0e-b534-dbd3f17d2fb3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:46.817627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:46.823651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:46.823946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:46.824229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] PATH_INFO: `/v3/projects/70af069a1c894951a01554026eaed57c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:46.825792 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70af069a1c894951a01554026eaed57c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:46.827872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:46.857327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:46.902504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70af069a1c894951a01554026eaed57c', 'request_id': 'req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.908873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70af069a1c894951a01554026eaed57c', 'request_id': 'req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.918877 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70af069a1c894951a01554026eaed57c', 'request_id': 'req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.936116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] The token cache is being invalidate because project 70af069a1c894951a01554026eaed57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:46.936484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.937076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b21c4b5-a4c5-4d70-b177-7b33400bdf34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:46.939089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1177/2324] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:46 2022] DELETE /identity/v3/projects/70af069a1c894951a01554026eaed57c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:46.943858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368983f-9c14-4cee-8982-e6a75837edcf None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:46.944973 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368983f-9c14-4cee-8982-e6a75837edcf None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:46.945367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368983f-9c14-4cee-8982-e6a75837edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:46.968465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9368983f-9c14-4cee-8982-e6a75837edcf None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:46.970042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9368983f-9c14-4cee-8982-e6a75837edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:47.040441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:47.072424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1148/2325] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:47.075664 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f479e4d-727a-44a2-a2fc-bb0b20b94cbb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.075938 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f479e4d-727a-44a2-a2fc-bb0b20b94cbb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.076125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f479e4d-727a-44a2-a2fc-bb0b20b94cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.118154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3f479e4d-727a-44a2-a2fc-bb0b20b94cbb None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:47.120505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3f479e4d-727a-44a2-a2fc-bb0b20b94cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:47.131709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1178/2326] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:47.136541 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368983f-9c14-4cee-8982-e6a75837edcf None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:47.146819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368983f-9c14-4cee-8982-e6a75837edcf None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:47.156793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:47.157525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.157887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.158636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.160053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:47.160351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:47.164700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:47.186792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1149/2327] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:47.190371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f479e4d-727a-44a2-a2fc-bb0b20b94cbb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:47.201910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f479e4d-727a-44a2-a2fc-bb0b20b94cbb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:47.207307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d0a75-4642-4a6e-855a-c976bc9be3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:47.207980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0a75-4642-4a6e-855a-c976bc9be3af admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.208328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0a75-4642-4a6e-855a-c976bc9be3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.208667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0a75-4642-4a6e-855a-c976bc9be3af admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.209367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d0a75-4642-4a6e-855a-c976bc9be3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:47.211638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d0a75-4642-4a6e-855a-c976bc9be3af admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:47.246141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1179/2328] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:47 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:47.247431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:47.258211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702066fb-d0a2-46d8-bf86-6959bdebae28 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:47.314769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ccdd5-18b1-4ad4-92ec-3ad5d30ce405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:47.315394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccdd5-18b1-4ad4-92ec-3ad5d30ce405 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.315666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccdd5-18b1-4ad4-92ec-3ad5d30ce405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.315930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccdd5-18b1-4ad4-92ec-3ad5d30ce405 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.316576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ccdd5-18b1-4ad4-92ec-3ad5d30ce405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:47.318517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ccdd5-18b1-4ad4-92ec-3ad5d30ce405 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:47.339920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1150/2329] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:47 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:47.343944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d0a75-4642-4a6e-855a-c976bc9be3af admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:47.354772 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d0a75-4642-4a6e-855a-c976bc9be3af admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:47.359836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964cdf-9f59-4ed3-9796-7202a007c48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:47.360431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964cdf-9f59-4ed3-9796-7202a007c48c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.360708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964cdf-9f59-4ed3-9796-7202a007c48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.360978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964cdf-9f59-4ed3-9796-7202a007c48c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.361612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964cdf-9f59-4ed3-9796-7202a007c48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:47.363243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964cdf-9f59-4ed3-9796-7202a007c48c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:47.373881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1180/2330] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:47.377944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ccdd5-18b1-4ad4-92ec-3ad5d30ce405 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:47.389301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ccdd5-18b1-4ad4-92ec-3ad5d30ce405 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:47.393903 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfcf7d-1279-4863-886b-eaa60d6ad1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:47.394487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfcf7d-1279-4863-886b-eaa60d6ad1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.394796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfcf7d-1279-4863-886b-eaa60d6ad1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.395139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfcf7d-1279-4863-886b-eaa60d6ad1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.395777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfcf7d-1279-4863-886b-eaa60d6ad1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:47.397421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfcf7d-1279-4863-886b-eaa60d6ad1fc admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:47.408123 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1151/2331] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:47.412350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964cdf-9f59-4ed3-9796-7202a007c48c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:47.423159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964cdf-9f59-4ed3-9796-7202a007c48c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:47.428043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:47.429450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.429745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.430011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] PATH_INFO: `/v3/projects/8027d73484a84a02b7793472d7e11772/users/1b9767a983444e78923d37ae70dd9a9e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.447366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8027d73484a84a02b7793472d7e11772, user_id=1b9767a983444e78923d37ae70dd9a9e, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:47.450096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:47.463515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1181/2332] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:47 2022] PUT /identity/v3/projects/8027d73484a84a02b7793472d7e11772/users/1b9767a983444e78923d37ae70dd9a9e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:47.473922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58433ded-d7fa-46d3-a44c-e405b647749c None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.474287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58433ded-d7fa-46d3-a44c-e405b647749c None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.474647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58433ded-d7fa-46d3-a44c-e405b647749c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.503228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-58433ded-d7fa-46d3-a44c-e405b647749c None None] MFA Rules not processed for user `1b9767a983444e78923d37ae70dd9a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:47.504571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-58433ded-d7fa-46d3-a44c-e405b647749c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:47.573533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1152/2333] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:47.586207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:47.587907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:47.673230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f3b4-4319-48e9-ad3f-9fcc40ea76ae admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:47.685442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222fa01-b347-4c88-826b-3516fd112f35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:47.686238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222fa01-b347-4c88-826b-3516fd112f35 service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:47.686521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222fa01-b347-4c88-826b-3516fd112f35 service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:47.686951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222fa01-b347-4c88-826b-3516fd112f35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:47.699122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222fa01-b347-4c88-826b-3516fd112f35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:47.700532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222fa01-b347-4c88-826b-3516fd112f35 service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:47.711426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1182/2334] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:53.240711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58433ded-d7fa-46d3-a44c-e405b647749c None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:53.242790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-58433ded-d7fa-46d3-a44c-e405b647749c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:53.351874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:53.363027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58433ded-d7fa-46d3-a44c-e405b647749c None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:53.371587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:53.372450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:53.372986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:53.373365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] PATH_INFO: `/v3/users/712d91c6dee74b0da708a2fc40784e24` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:53.375719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712d91c6dee74b0da708a2fc40784e24)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:53.378537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:53.462112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712d91c6dee74b0da708a2fc40784e24'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:53.474879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712d91c6dee74b0da708a2fc40784e24'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:53.475729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712d91c6dee74b0da708a2fc40784e24'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:53.476404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712d91c6dee74b0da708a2fc40784e24'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:53.486692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712d91c6dee74b0da708a2fc40784e24'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:53.518384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1153/2335] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:02:53 2022] DELETE /identity/v3/users/712d91c6dee74b0da708a2fc40784e24 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:53.527297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a966b58-96e1-4cdd-8a85-376bbf4940d3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:53.528346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a966b58-96e1-4cdd-8a85-376bbf4940d3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:53.528632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a966b58-96e1-4cdd-8a85-376bbf4940d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:53.584476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9a966b58-96e1-4cdd-8a85-376bbf4940d3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:53.603395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9a966b58-96e1-4cdd-8a85-376bbf4940d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:53.654527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:53.692781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1183/2336] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:53.724017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:53.725639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:53.804415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35089af5-0f07-4dfd-89cf-750463464c28 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:53.809595 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75b060-f052-49a7-8541-cfab5ae6db1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:53.810394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75b060-f052-49a7-8541-cfab5ae6db1c service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:53.810898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75b060-f052-49a7-8541-cfab5ae6db1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:53.812503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75b060-f052-49a7-8541-cfab5ae6db1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:53.831438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75b060-f052-49a7-8541-cfab5ae6db1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:53.832891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75b060-f052-49a7-8541-cfab5ae6db1c service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:53.854992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1154/2337] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:54.270871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a966b58-96e1-4cdd-8a85-376bbf4940d3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:54.272333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9a966b58-96e1-4cdd-8a85-376bbf4940d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:54.283980 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a966b58-96e1-4cdd-8a85-376bbf4940d3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:54.289198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:54.289821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.290094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.290360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] PATH_INFO: `/v3/projects/05ab35c2d3124e869790d9a69108c0ea` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.291510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ab35c2d3124e869790d9a69108c0ea)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:54.293405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:54.344214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ab35c2d3124e869790d9a69108c0ea', 'request_id': 'req-6a617835-e1fa-4210-a6aa-055e5af72f87'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:54.349568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ab35c2d3124e869790d9a69108c0ea', 'request_id': 'req-6a617835-e1fa-4210-a6aa-055e5af72f87'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:54.357567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ab35c2d3124e869790d9a69108c0ea', 'request_id': 'req-6a617835-e1fa-4210-a6aa-055e5af72f87'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:54.369471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] The token cache is being invalidate because project 05ab35c2d3124e869790d9a69108c0ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:02:54.370055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:54.371471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6a617835-e1fa-4210-a6aa-055e5af72f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:02:54.372997 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1184/2338] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:02:54 2022] DELETE /identity/v3/projects/05ab35c2d3124e869790d9a69108c0ea => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:54.435246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b57f5-7e68-4120-b227-de2ce86462a2 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.435829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b57f5-7e68-4120-b227-de2ce86462a2 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.435998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b57f5-7e68-4120-b227-de2ce86462a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.457245 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b63b57f5-7e68-4120-b227-de2ce86462a2 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:54.458460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b63b57f5-7e68-4120-b227-de2ce86462a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:54.521996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1155/2339] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:54.529412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7e278-5f65-45ac-83f8-d6a9407f690b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.529902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7e278-5f65-45ac-83f8-d6a9407f690b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.529995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7e278-5f65-45ac-83f8-d6a9407f690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.549690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-15a7e278-5f65-45ac-83f8-d6a9407f690b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:54.550882 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15a7e278-5f65-45ac-83f8-d6a9407f690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:54.559900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1185/2340] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:54.564206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b57f5-7e68-4120-b227-de2ce86462a2 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:54.575081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b57f5-7e68-4120-b227-de2ce86462a2 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:54.579721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:54.580382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.580720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.581055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.582225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:02:54.582619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:54.584299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:54.597009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1156/2341] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:02:54.601718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7e278-5f65-45ac-83f8-d6a9407f690b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:54.612856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7e278-5f65-45ac-83f8-d6a9407f690b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:54.619283 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8976-107c-4f0a-b0ca-100c9c7f4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:54.620076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8976-107c-4f0a-b0ca-100c9c7f4dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.620350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8976-107c-4f0a-b0ca-100c9c7f4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.620611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8976-107c-4f0a-b0ca-100c9c7f4dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.621556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8976-107c-4f0a-b0ca-100c9c7f4dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:54.623294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8976-107c-4f0a-b0ca-100c9c7f4dd8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:54.670028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1186/2342] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:54 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:02:54.673893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:54.684312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:54.689729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebd2c0-a1c1-4930-9a41-96a32011d54c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:54.765473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162718c8-e3d8-42eb-9fa2-adc27e01670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:54.766079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162718c8-e3d8-42eb-9fa2-adc27e01670e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.766382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162718c8-e3d8-42eb-9fa2-adc27e01670e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.766651 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162718c8-e3d8-42eb-9fa2-adc27e01670e admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.767313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162718c8-e3d8-42eb-9fa2-adc27e01670e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:54.769194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162718c8-e3d8-42eb-9fa2-adc27e01670e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:54.791293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1157/2343] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:54 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:54.795565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8976-107c-4f0a-b0ca-100c9c7f4dd8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:54.807302 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8976-107c-4f0a-b0ca-100c9c7f4dd8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:54.812031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd50eda-8bce-4c78-94dc-a7513b2613f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:54.812638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd50eda-8bce-4c78-94dc-a7513b2613f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.812910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd50eda-8bce-4c78-94dc-a7513b2613f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.813173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd50eda-8bce-4c78-94dc-a7513b2613f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.813809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd50eda-8bce-4c78-94dc-a7513b2613f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:54.815424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd50eda-8bce-4c78-94dc-a7513b2613f6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:54.826670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1187/2344] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:54.830726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162718c8-e3d8-42eb-9fa2-adc27e01670e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:54.841347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162718c8-e3d8-42eb-9fa2-adc27e01670e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:54.845843 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1ca3d-170b-4839-bc33-267d8a803599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:54.846422 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ca3d-170b-4839-bc33-267d8a803599 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.846692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ca3d-170b-4839-bc33-267d8a803599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.846990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ca3d-170b-4839-bc33-267d8a803599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.847619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1ca3d-170b-4839-bc33-267d8a803599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:54.849184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1ca3d-170b-4839-bc33-267d8a803599 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:54.859972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1158/2345] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:54.863978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd50eda-8bce-4c78-94dc-a7513b2613f6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:54.875476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd50eda-8bce-4c78-94dc-a7513b2613f6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:54.880552 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8312-4058-4b45-bb96-4bd653e449aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:54.881275 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8312-4058-4b45-bb96-4bd653e449aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.882301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8312-4058-4b45-bb96-4bd653e449aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.882646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8312-4058-4b45-bb96-4bd653e449aa admin admin] PATH_INFO: `/v3/projects/3cdc6bd4c4fd477ca499367ec1452f96/users/fe0e00ede02d46329bb1a1e307a3e24c/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.900723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c8312-4058-4b45-bb96-4bd653e449aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdc6bd4c4fd477ca499367ec1452f96, user_id=fe0e00ede02d46329bb1a1e307a3e24c, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:54.904222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c8312-4058-4b45-bb96-4bd653e449aa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:54.918446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1188/2346] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:54 2022] PUT /identity/v3/projects/3cdc6bd4c4fd477ca499367ec1452f96/users/fe0e00ede02d46329bb1a1e307a3e24c/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:54.929526 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299701-9a35-44d0-bbbb-da5729e8ff90 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:54.929879 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299701-9a35-44d0-bbbb-da5729e8ff90 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:54.930153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299701-9a35-44d0-bbbb-da5729e8ff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:54.965648 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-c5299701-9a35-44d0-bbbb-da5729e8ff90 None None] MFA Rules not processed for user `fe0e00ede02d46329bb1a1e307a3e24c`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:54.966898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c5299701-9a35-44d0-bbbb-da5729e8ff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:55.076138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1159/2347] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:55.080976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8312-4058-4b45-bb96-4bd653e449aa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:55.170245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8312-4058-4b45-bb96-4bd653e449aa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:55.176425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e65ad-2671-452b-843a-11ac78237152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:55.177033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e65ad-2671-452b-843a-11ac78237152 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:55.178027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e65ad-2671-452b-843a-11ac78237152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:55.178306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e65ad-2671-452b-843a-11ac78237152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:55.180044 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e65ad-2671-452b-843a-11ac78237152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:55.181937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e65ad-2671-452b-843a-11ac78237152 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:55.192791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:55.227131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1189/2348] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:55 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:55.230667 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299701-9a35-44d0-bbbb-da5729e8ff90 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:55.244629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299701-9a35-44d0-bbbb-da5729e8ff90 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:55.336855 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce232d-d01d-4908-9d38-fe5a3b27974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:55.337644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce232d-d01d-4908-9d38-fe5a3b27974a admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:55.337923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce232d-d01d-4908-9d38-fe5a3b27974a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:55.338190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce232d-d01d-4908-9d38-fe5a3b27974a admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:55.339914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce232d-d01d-4908-9d38-fe5a3b27974a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:55.341419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce232d-d01d-4908-9d38-fe5a3b27974a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:55.370051 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1160/2349] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:55 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:55.374483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e65ad-2671-452b-843a-11ac78237152 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:55.387256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e65ad-2671-452b-843a-11ac78237152 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:55.392405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3313ab8-88ba-4a4d-a38c-3c21c71b69b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:55.393000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3313ab8-88ba-4a4d-a38c-3c21c71b69b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:55.393272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3313ab8-88ba-4a4d-a38c-3c21c71b69b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:55.393544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3313ab8-88ba-4a4d-a38c-3c21c71b69b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:55.394182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3313ab8-88ba-4a4d-a38c-3c21c71b69b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:55.395781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3313ab8-88ba-4a4d-a38c-3c21c71b69b2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:55.406318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1190/2350] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:55.410301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce232d-d01d-4908-9d38-fe5a3b27974a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:55.415617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:55.421970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce232d-d01d-4908-9d38-fe5a3b27974a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:55.426901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe053629-2a8e-4da3-bd70-9b2f1e5929f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:55.427489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053629-2a8e-4da3-bd70-9b2f1e5929f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:55.427767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053629-2a8e-4da3-bd70-9b2f1e5929f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:55.428138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053629-2a8e-4da3-bd70-9b2f1e5929f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:55.429215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe053629-2a8e-4da3-bd70-9b2f1e5929f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:55.430869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe053629-2a8e-4da3-bd70-9b2f1e5929f1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:55.445902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1161/2351] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:55.447951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3313ab8-88ba-4a4d-a38c-3c21c71b69b2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:55.458285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3313ab8-88ba-4a4d-a38c-3c21c71b69b2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:55.463006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e98951-d680-4b54-9be2-dbc6e25efa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:55.463668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98951-d680-4b54-9be2-dbc6e25efa4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:55.463955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98951-d680-4b54-9be2-dbc6e25efa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:55.464222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98951-d680-4b54-9be2-dbc6e25efa4a admin admin] PATH_INFO: `/v3/projects/d1c1a717ab6c4cbba3c1028f61f00d3f/users/bb9ec7290f1544cc8e220612242ad32f/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:55.479533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e98951-d680-4b54-9be2-dbc6e25efa4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c1a717ab6c4cbba3c1028f61f00d3f, user_id=bb9ec7290f1544cc8e220612242ad32f, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:55.482212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e98951-d680-4b54-9be2-dbc6e25efa4a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:55.495925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1191/2352] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:55 2022] PUT /identity/v3/projects/d1c1a717ab6c4cbba3c1028f61f00d3f/users/bb9ec7290f1544cc8e220612242ad32f/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:55.510348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a328b3-2a15-404e-aa1b-8d3c716eae13 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:55.510979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a328b3-2a15-404e-aa1b-8d3c716eae13 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:55.511439 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a328b3-2a15-404e-aa1b-8d3c716eae13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:55.540458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d2a328b3-2a15-404e-aa1b-8d3c716eae13 None None] MFA Rules not processed for user `bb9ec7290f1544cc8e220612242ad32f`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:55.541694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d2a328b3-2a15-404e-aa1b-8d3c716eae13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:55.618124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1162/2353] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:55.619371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e98951-d680-4b54-9be2-dbc6e25efa4a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:55.761946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e98951-d680-4b54-9be2-dbc6e25efa4a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:55.770470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d8b8-42a9-44fb-ac41-7c3fdee08ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:55.771497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d8b8-42a9-44fb-ac41-7c3fdee08ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:55.771782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d8b8-42a9-44fb-ac41-7c3fdee08ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:55.772244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d8b8-42a9-44fb-ac41-7c3fdee08ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:55.773699 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d8b8-42a9-44fb-ac41-7c3fdee08ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:55.777074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d8b8-42a9-44fb-ac41-7c3fdee08ec7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:55.845701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1192/2354] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:02:55 2022] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:02:55.849828 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a328b3-2a15-404e-aa1b-8d3c716eae13 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:55.868485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a328b3-2a15-404e-aa1b-8d3c716eae13 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:55.960482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0a04a-f037-4e0c-8b7a-f1e9dd6b6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:55.961170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a04a-f037-4e0c-8b7a-f1e9dd6b6ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:55.961443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a04a-f037-4e0c-8b7a-f1e9dd6b6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:55.961713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a04a-f037-4e0c-8b7a-f1e9dd6b6ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:55.962364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0a04a-f037-4e0c-8b7a-f1e9dd6b6ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:55.964354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0a04a-f037-4e0c-8b7a-f1e9dd6b6ab6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:55.986796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1163/2355] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:02:55 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:02:55.989449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d8b8-42a9-44fb-ac41-7c3fdee08ec7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:56.000228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d8b8-42a9-44fb-ac41-7c3fdee08ec7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:56.004844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cffc-86e2-46a1-a924-f650c31e413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:56.005440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cffc-86e2-46a1-a924-f650c31e413a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:56.005741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cffc-86e2-46a1-a924-f650c31e413a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:56.006011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cffc-86e2-46a1-a924-f650c31e413a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:56.007407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cffc-86e2-46a1-a924-f650c31e413a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:56.009438 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cffc-86e2-46a1-a924-f650c31e413a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:56.025551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1193/2356] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:56.029434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0a04a-f037-4e0c-8b7a-f1e9dd6b6ab6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:56.040713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0a04a-f037-4e0c-8b7a-f1e9dd6b6ab6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:56.046964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2559-1e26-498a-b9b2-d97492abb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:56.047615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2559-1e26-498a-b9b2-d97492abb271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:56.047894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2559-1e26-498a-b9b2-d97492abb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:56.048165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2559-1e26-498a-b9b2-d97492abb271 admin admin] PATH_INFO: `/v3/projects/bb9ec4bc73fc4cefb90f05e6fe2fbabf/users/48bf7048eca74d21a7d47d436d4ab5f9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:56.063256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b2559-1e26-498a-b9b2-d97492abb271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9ec4bc73fc4cefb90f05e6fe2fbabf, user_id=48bf7048eca74d21a7d47d436d4ab5f9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:56.065895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b2559-1e26-498a-b9b2-d97492abb271 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:56.079080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1164/2357] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:56 2022] PUT /identity/v3/projects/bb9ec4bc73fc4cefb90f05e6fe2fbabf/users/48bf7048eca74d21a7d47d436d4ab5f9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:02:56.083072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cffc-86e2-46a1-a924-f650c31e413a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:56.094820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cffc-86e2-46a1-a924-f650c31e413a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:56.152467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c74eb-ad79-4528-bdbf-6026e4638284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:56.153091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c74eb-ad79-4528-bdbf-6026e4638284 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:56.153402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c74eb-ad79-4528-bdbf-6026e4638284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:56.153710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c74eb-ad79-4528-bdbf-6026e4638284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:56.154360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c74eb-ad79-4528-bdbf-6026e4638284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:56.156190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c74eb-ad79-4528-bdbf-6026e4638284 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:56.168365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1194/2358] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:02:56.172435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2559-1e26-498a-b9b2-d97492abb271 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:56.183624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2559-1e26-498a-b9b2-d97492abb271 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:56.188249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:56.188892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:56.189171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:56.189443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] PATH_INFO: `/v3/projects/bb9ec4bc73fc4cefb90f05e6fe2fbabf/users/48bf7048eca74d21a7d47d436d4ab5f9/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:56.191494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9ec4bc73fc4cefb90f05e6fe2fbabf, user_id=48bf7048eca74d21a7d47d436d4ab5f9, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:56.194780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:56.205692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1165/2359] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:02:56 2022] PUT /identity/v3/projects/bb9ec4bc73fc4cefb90f05e6fe2fbabf/users/48bf7048eca74d21a7d47d436d4ab5f9/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:02:56.215949 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa45867-e295-49a4-9263-dc8f96dfbe04 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:56.216274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa45867-e295-49a4-9263-dc8f96dfbe04 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:56.216689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa45867-e295-49a4-9263-dc8f96dfbe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:56.249449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7fa45867-e295-49a4-9263-dc8f96dfbe04 None None] MFA Rules not processed for user `48bf7048eca74d21a7d47d436d4ab5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:02:56.251208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7fa45867-e295-49a4-9263-dc8f96dfbe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:56.265191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:56.334529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1195/2360] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:02:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:02:56.346347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:56.347972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:56.417445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:56.483600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01160e-7830-465a-88f3-08646e7127f9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:56.492022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:56.502976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:56.503347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:56.503630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:56.583410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:56.586565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:56.600169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1166/2361] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:58.298815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa45867-e295-49a4-9263-dc8f96dfbe04 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:58.311806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa45867-e295-49a4-9263-dc8f96dfbe04 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:58.315814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1869de-3656-4b1d-acb8-c5e04e1b68b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:58.316473 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1869de-3656-4b1d-acb8-c5e04e1b68b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:58.316793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1869de-3656-4b1d-acb8-c5e04e1b68b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:58.317153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1869de-3656-4b1d-acb8-c5e04e1b68b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:58.387773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1869de-3656-4b1d-acb8-c5e04e1b68b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:58.389297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1869de-3656-4b1d-acb8-c5e04e1b68b3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:58.399572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1196/2362] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:02:59.112930 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:02:59.114368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:02:59.128764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422a4e-05c9-402f-bbf5-ba76a607125a service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:02:59.134896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:02:59.135539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:02:59.136529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:02:59.136529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:02:59.150880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:02:59.154104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:02:59.187771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1167/2363] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:02:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:00.501180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc9bc-9dd8-4238-a285-83b1ae71b718 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:00.504544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc9bc-9dd8-4238-a285-83b1ae71b718 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:00.504871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc9bc-9dd8-4238-a285-83b1ae71b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:00.535542 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-62dbc9bc-9dd8-4238-a285-83b1ae71b718 None None] MFA Rules not processed for user `cd5ac67dae69446eb8695af69daa439f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:00.537124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-62dbc9bc-9dd8-4238-a285-83b1ae71b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:00.612667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1197/2364] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:02.308244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:02.309718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:02.372322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de76c1-7b15-4e0a-8107-abdbdecef4ae service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:02.376083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdce5d4-6b3b-44c4-863f-8e03a73ce489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:02.376675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce5d4-6b3b-44c4-863f-8e03a73ce489 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:02.376961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce5d4-6b3b-44c4-863f-8e03a73ce489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:02.377217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce5d4-6b3b-44c4-863f-8e03a73ce489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:02.378939 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9fdce5d4-6b3b-44c4-863f-8e03a73ce489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:02.461614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdce5d4-6b3b-44c4-863f-8e03a73ce489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:02.463077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdce5d4-6b3b-44c4-863f-8e03a73ce489 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:02.473763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1168/2365] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:03:03.267249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbc9bc-9dd8-4238-a285-83b1ae71b718 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:03.364135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:03.377007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbc9bc-9dd8-4238-a285-83b1ae71b718 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:03.382010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:03.382937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:03.383314 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:03.383728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] PATH_INFO: `/v3/users/fe0e00ede02d46329bb1a1e307a3e24c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:03.385460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0e00ede02d46329bb1a1e307a3e24c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:03.388182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:03.449507 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0e00ede02d46329bb1a1e307a3e24c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:03.458160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0e00ede02d46329bb1a1e307a3e24c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:03.459020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0e00ede02d46329bb1a1e307a3e24c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:03.460218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0e00ede02d46329bb1a1e307a3e24c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:03.469458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0e00ede02d46329bb1a1e307a3e24c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:03.494788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1198/2366] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:03:03 2022] DELETE /identity/v3/users/fe0e00ede02d46329bb1a1e307a3e24c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:03.498866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a15c68-6dbb-4fdb-a2ea-48e0de9f1639 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:03.499755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a15c68-6dbb-4fdb-a2ea-48e0de9f1639 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:03.500248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a15c68-6dbb-4fdb-a2ea-48e0de9f1639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:03.524331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-48a15c68-6dbb-4fdb-a2ea-48e0de9f1639 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:03.534173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-48a15c68-6dbb-4fdb-a2ea-48e0de9f1639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:03.567979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:03.628942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1169/2367] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:03.640726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:03.649058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:03.728202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887b66b-98d0-48d3-973f-50e5bd3f621f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:03.734377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a078806-ae9c-41dd-a00c-516e078d06b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:03.735129 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078806-ae9c-41dd-a00c-516e078d06b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:03.735410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078806-ae9c-41dd-a00c-516e078d06b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:03.735742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078806-ae9c-41dd-a00c-516e078d06b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:03.750971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a078806-ae9c-41dd-a00c-516e078d06b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:03.752979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a078806-ae9c-41dd-a00c-516e078d06b0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:03.764453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1199/2368] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:04.274090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a15c68-6dbb-4fdb-a2ea-48e0de9f1639 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:04.275571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-48a15c68-6dbb-4fdb-a2ea-48e0de9f1639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:04.287793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a15c68-6dbb-4fdb-a2ea-48e0de9f1639 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:04.294908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:04.295552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:04.295846 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:04.296114 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] PATH_INFO: `/v3/projects/3cdc6bd4c4fd477ca499367ec1452f96` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:04.297277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cdc6bd4c4fd477ca499367ec1452f96)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:04.299213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:04.414431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdc6bd4c4fd477ca499367ec1452f96', 'request_id': 'req-9b6bba07-b1fc-422a-a657-f3928dd68244'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.424188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdc6bd4c4fd477ca499367ec1452f96', 'request_id': 'req-9b6bba07-b1fc-422a-a657-f3928dd68244'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.435854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdc6bd4c4fd477ca499367ec1452f96', 'request_id': 'req-9b6bba07-b1fc-422a-a657-f3928dd68244'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.453886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] The token cache is being invalidate because project 3cdc6bd4c4fd477ca499367ec1452f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:03:04.454180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.455045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.457738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1170/2369] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:03:04 2022] DELETE /identity/v3/projects/3cdc6bd4c4fd477ca499367ec1452f96 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:03:04.462488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a078806-ae9c-41dd-a00c-516e078d06b0 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:04.472960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a078806-ae9c-41dd-a00c-516e078d06b0 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:04.574244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:04.575453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:04.577546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:04.577945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] PATH_INFO: `/v3/users/bb9ec7290f1544cc8e220612242ad32f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:04.581778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9ec7290f1544cc8e220612242ad32f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:04.585745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:04.634415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:04.714845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9ec7290f1544cc8e220612242ad32f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.728858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9ec7290f1544cc8e220612242ad32f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.729861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9ec7290f1544cc8e220612242ad32f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.731186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9ec7290f1544cc8e220612242ad32f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.744965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9ec7290f1544cc8e220612242ad32f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:04.810771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1200/2370] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:03:04 2022] DELETE /identity/v3/users/bb9ec7290f1544cc8e220612242ad32f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:05.497480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:05.500900 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:05.526555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bba07-b1fc-422a-a657-f3928dd68244 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:05.617242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:05.618070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:05.619093 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:05.619550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] PATH_INFO: `/v3/projects/d1c1a717ab6c4cbba3c1028f61f00d3f` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:05.622008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c1a717ab6c4cbba3c1028f61f00d3f)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:05.626894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:05.734686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c1a717ab6c4cbba3c1028f61f00d3f', 'request_id': 'req-d2c32580-9116-48ff-a818-21f1e20fa102'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:05.736784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:05.744953 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c1a717ab6c4cbba3c1028f61f00d3f', 'request_id': 'req-d2c32580-9116-48ff-a818-21f1e20fa102'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:05.774024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c1a717ab6c4cbba3c1028f61f00d3f', 'request_id': 'req-d2c32580-9116-48ff-a818-21f1e20fa102'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:05.791251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] The token cache is being invalidate because project d1c1a717ab6c4cbba3c1028f61f00d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:03:05.791546 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:05.792250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:05.793782 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1171/2371] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:03:05 2022] DELETE /identity/v3/projects/d1c1a717ab6c4cbba3c1028f61f00d3f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:05.798971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:05.800909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:05.820170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8f55-17c3-4890-9ba0-00230a9471c1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:05.945894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:05.946658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:05.947076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:05.947420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] PATH_INFO: `/v3/users/48bf7048eca74d21a7d47d436d4ab5f9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:05.949026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bf7048eca74d21a7d47d436d4ab5f9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:05.954196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:06.063925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bf7048eca74d21a7d47d436d4ab5f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.080121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bf7048eca74d21a7d47d436d4ab5f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.080777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bf7048eca74d21a7d47d436d4ab5f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.081819 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bf7048eca74d21a7d47d436d4ab5f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.106163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73bed4b-0ea8-406e-8498-4f5634269205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bf7048eca74d21a7d47d436d4ab5f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.180757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1201/2372] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:03:05 2022] DELETE /identity/v3/users/48bf7048eca74d21a7d47d436d4ab5f9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:06.681662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:06.684253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:06.698988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32580-9116-48ff-a818-21f1e20fa102 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:06.778781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:06.780386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:06.780386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:06.780386 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] PATH_INFO: `/v3/projects/bb9ec4bc73fc4cefb90f05e6fe2fbabf` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:06.793333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9ec4bc73fc4cefb90f05e6fe2fbabf)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:06.795517 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:06.857056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9ec4bc73fc4cefb90f05e6fe2fbabf', 'request_id': 'req-0c807b5b-66ef-4574-97e4-954601365b1e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.863445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9ec4bc73fc4cefb90f05e6fe2fbabf', 'request_id': 'req-0c807b5b-66ef-4574-97e4-954601365b1e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.874040 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9ec4bc73fc4cefb90f05e6fe2fbabf', 'request_id': 'req-0c807b5b-66ef-4574-97e4-954601365b1e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.888734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] The token cache is being invalidate because project bb9ec4bc73fc4cefb90f05e6fe2fbabf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:03:06.889137 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.889873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:06.891689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1172/2373] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:03:06 2022] DELETE /identity/v3/projects/bb9ec4bc73fc4cefb90f05e6fe2fbabf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:07.961442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a867b-4e72-427d-bf29-b549ec54facd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:07.961982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a867b-4e72-427d-bf29-b549ec54facd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:07.961982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a867b-4e72-427d-bf29-b549ec54facd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:07.981911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7f2a867b-4e72-427d-bf29-b549ec54facd None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:07.983254 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f2a867b-4e72-427d-bf29-b549ec54facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:07.992024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:08.043488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1202/2374] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:03:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:08.087020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:08.088432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:08.159486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807b5b-66ef-4574-97e4-954601365b1e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:08.165108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faa3cd-b79f-4653-bcf4-949e3ebb6446 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:08.165715 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa3cd-b79f-4653-bcf4-949e3ebb6446 service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:08.165999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa3cd-b79f-4653-bcf4-949e3ebb6446 service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:08.166269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa3cd-b79f-4653-bcf4-949e3ebb6446 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:08.174678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faa3cd-b79f-4653-bcf4-949e3ebb6446 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:08.176284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faa3cd-b79f-4653-bcf4-949e3ebb6446 service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:08.179831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:08.186617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1173/2375] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:03:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:03:13.590367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a867b-4e72-427d-bf29-b549ec54facd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:13.593022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f2a867b-4e72-427d-bf29-b549ec54facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:13.712335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a867b-4e72-427d-bf29-b549ec54facd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:13.720504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:13.721631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:13.722017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:13.722532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] PATH_INFO: `/v3/users/1b9767a983444e78923d37ae70dd9a9e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:13.724170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9767a983444e78923d37ae70dd9a9e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:13.727380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:13.796007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9767a983444e78923d37ae70dd9a9e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:13.805943 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9767a983444e78923d37ae70dd9a9e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:13.806644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9767a983444e78923d37ae70dd9a9e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:13.807519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9767a983444e78923d37ae70dd9a9e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:13.816194 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9767a983444e78923d37ae70dd9a9e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:13.840279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1203/2376] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:03:13 2022] DELETE /identity/v3/users/1b9767a983444e78923d37ae70dd9a9e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:13.844836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cefe2f-3156-407e-b42b-e59f7cce3b63 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:13.845397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cefe2f-3156-407e-b42b-e59f7cce3b63 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:13.845540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cefe2f-3156-407e-b42b-e59f7cce3b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:13.871725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-18cefe2f-3156-407e-b42b-e59f7cce3b63 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:13.873078 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-18cefe2f-3156-407e-b42b-e59f7cce3b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:13.950585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1174/2377] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:13.961489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:13.963203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:14.010397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:14.030931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28674fa2-5208-4db6-94ad-539935634083 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:14.034889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82143ea-d51a-4dc4-bd19-c1b1183a298a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:14.035629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82143ea-d51a-4dc4-bd19-c1b1183a298a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:14.035824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82143ea-d51a-4dc4-bd19-c1b1183a298a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:14.036074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82143ea-d51a-4dc4-bd19-c1b1183a298a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:14.059513 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82143ea-d51a-4dc4-bd19-c1b1183a298a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:14.061251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82143ea-d51a-4dc4-bd19-c1b1183a298a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:14.073095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1204/2378] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:14.409351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cefe2f-3156-407e-b42b-e59f7cce3b63 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:14.411213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-18cefe2f-3156-407e-b42b-e59f7cce3b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:14.430292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cefe2f-3156-407e-b42b-e59f7cce3b63 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:14.439928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:14.440579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:14.440848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:14.441202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] PATH_INFO: `/v3/projects/8027d73484a84a02b7793472d7e11772` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:14.442440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8027d73484a84a02b7793472d7e11772)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:14.449022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:14.536372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8027d73484a84a02b7793472d7e11772', 'request_id': 'req-707dd3c4-5268-482d-85e6-72ada4454bcf'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:14.542818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8027d73484a84a02b7793472d7e11772', 'request_id': 'req-707dd3c4-5268-482d-85e6-72ada4454bcf'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:14.550436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8027d73484a84a02b7793472d7e11772', 'request_id': 'req-707dd3c4-5268-482d-85e6-72ada4454bcf'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:14.565365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] The token cache is being invalidate because project 8027d73484a84a02b7793472d7e11772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:03:14.565688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:14.566368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-707dd3c4-5268-482d-85e6-72ada4454bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:14.568234 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1175/2379] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:03:14 2022] DELETE /identity/v3/projects/8027d73484a84a02b7793472d7e11772 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:14.573301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ba7c-acc6-4f9b-9451-62641706808e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:14.573586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ba7c-acc6-4f9b-9451-62641706808e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:14.573861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ba7c-acc6-4f9b-9451-62641706808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:14.597736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e186ba7c-acc6-4f9b-9451-62641706808e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:14.599018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e186ba7c-acc6-4f9b-9451-62641706808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:14.678812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1205/2380] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:14.687096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a52ac-aad8-4274-b948-90238beae009 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:14.687729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a52ac-aad8-4274-b948-90238beae009 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:14.688006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a52ac-aad8-4274-b948-90238beae009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:14.713089 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4d1a52ac-aad8-4274-b948-90238beae009 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:14.714307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4d1a52ac-aad8-4274-b948-90238beae009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:14.724207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1176/2381] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:14.728918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186ba7c-acc6-4f9b-9451-62641706808e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:14.739322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186ba7c-acc6-4f9b-9451-62641706808e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:14.744796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:14.745465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:14.745777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:14.746021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:14.746679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:03:14.747011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:14.748604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:14.768002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1206/2382] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:03:14.772349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a52ac-aad8-4274-b948-90238beae009 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:14.782545 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a52ac-aad8-4274-b948-90238beae009 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:14.789337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1959ec-0382-4695-96ab-dbb0dd861f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:14.789966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1959ec-0382-4695-96ab-dbb0dd861f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:14.790239 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1959ec-0382-4695-96ab-dbb0dd861f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:14.790511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1959ec-0382-4695-96ab-dbb0dd861f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:14.791198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1959ec-0382-4695-96ab-dbb0dd861f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:14.793169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1959ec-0382-4695-96ab-dbb0dd861f8a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:14.831117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1177/2383] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:03:14 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:14.832104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:14.844689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb80b4-15b8-4ec0-aba9-e9be24d01a98 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:14.924331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32641550-6f2e-4b18-93b4-a99f26e718bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:14.924978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641550-6f2e-4b18-93b4-a99f26e718bd admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:14.925273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641550-6f2e-4b18-93b4-a99f26e718bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:14.925546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641550-6f2e-4b18-93b4-a99f26e718bd admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:14.926573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32641550-6f2e-4b18-93b4-a99f26e718bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:14.928888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32641550-6f2e-4b18-93b4-a99f26e718bd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:14.964274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1207/2384] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:03:14 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:03:14.965686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1959ec-0382-4695-96ab-dbb0dd861f8a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:14.981577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1959ec-0382-4695-96ab-dbb0dd861f8a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:14.991515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022866b1-3b72-4e4c-aca1-cd0613e97b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:14.992409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022866b1-3b72-4e4c-aca1-cd0613e97b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:14.992878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022866b1-3b72-4e4c-aca1-cd0613e97b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:14.993392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022866b1-3b72-4e4c-aca1-cd0613e97b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:14.994334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022866b1-3b72-4e4c-aca1-cd0613e97b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:14.996571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022866b1-3b72-4e4c-aca1-cd0613e97b35 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:15.010039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1178/2385] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:03:15.013957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32641550-6f2e-4b18-93b4-a99f26e718bd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:15.028768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32641550-6f2e-4b18-93b4-a99f26e718bd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:15.040839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639d401-2784-4744-8f2c-c695431aef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:15.042041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639d401-2784-4744-8f2c-c695431aef79 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:15.043795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639d401-2784-4744-8f2c-c695431aef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:15.043925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639d401-2784-4744-8f2c-c695431aef79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:15.044615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639d401-2784-4744-8f2c-c695431aef79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:15.046971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639d401-2784-4744-8f2c-c695431aef79 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:15.068574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1208/2386] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:03:15.070717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022866b1-3b72-4e4c-aca1-cd0613e97b35 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:15.085882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022866b1-3b72-4e4c-aca1-cd0613e97b35 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:15.090573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:15.091277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:15.091551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:15.091821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] PATH_INFO: `/v3/projects/3737c60ed18c4072af042cb544a6c237/users/42108d6d996840c48288d86e181a77a9/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:15.110012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3737c60ed18c4072af042cb544a6c237, user_id=42108d6d996840c48288d86e181a77a9, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:15.112683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:15.128644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1179/2387] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:03:15 2022] PUT /identity/v3/projects/3737c60ed18c4072af042cb544a6c237/users/42108d6d996840c48288d86e181a77a9/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:03:15.139770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b215409-81ee-450a-988f-d4d15c802de4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:15.140052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b215409-81ee-450a-988f-d4d15c802de4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:15.140386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b215409-81ee-450a-988f-d4d15c802de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:15.173229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1b215409-81ee-450a-988f-d4d15c802de4 None None] MFA Rules not processed for user `42108d6d996840c48288d86e181a77a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:15.174874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1b215409-81ee-450a-988f-d4d15c802de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:15.214156 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:15.262824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1209/2388] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:15.274485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:15.276282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:15.299753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:15.346295 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6477c-c0a0-4e95-8683-d11d14964e29 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:15.350862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:15.351539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:15.351874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:15.352297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:15.362273 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:15.364079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:15.382909 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1180/2389] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:25.259181 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=11 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:25.369212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=18 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:26.656683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c49f-67c7-4bd9-aa01-e7239dd4076a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:26.657136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c49f-67c7-4bd9-aa01-e7239dd4076a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:26.657249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c49f-67c7-4bd9-aa01-e7239dd4076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:26.677262 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f0a5c49f-67c7-4bd9-aa01-e7239dd4076a None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:26.678619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f0a5c49f-67c7-4bd9-aa01-e7239dd4076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:26.737732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1210/2390] 10.222.0.26 () {58 vars in 967 bytes} [Sat Sep 24 05:03:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:26.758187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:26.759959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:26.839184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb27c-279b-4460-b7dd-83123c1c8acd service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:26.844284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1379-1ab6-4dd8-880d-3280b40e6860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:26.844946 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1379-1ab6-4dd8-880d-3280b40e6860 service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:26.845221 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1379-1ab6-4dd8-880d-3280b40e6860 service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:26.845490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1379-1ab6-4dd8-880d-3280b40e6860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:26.854213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe1379-1ab6-4dd8-880d-3280b40e6860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:26.855824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe1379-1ab6-4dd8-880d-3280b40e6860 service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:26.864204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1181/2391] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:03:28.848422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5c49f-67c7-4bd9-aa01-e7239dd4076a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:28.849871 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f0a5c49f-67c7-4bd9-aa01-e7239dd4076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:28.921386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5c49f-67c7-4bd9-aa01-e7239dd4076a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:28.925801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:28.926446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:28.926719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:28.927025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] PATH_INFO: `/v3/users/35af5fb664c043faa62acf8e5be03c0a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:28.928134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35af5fb664c043faa62acf8e5be03c0a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:28.930365 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:28.979256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35af5fb664c043faa62acf8e5be03c0a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:28.986350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35af5fb664c043faa62acf8e5be03c0a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:28.987012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35af5fb664c043faa62acf8e5be03c0a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:28.987612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35af5fb664c043faa62acf8e5be03c0a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:28.994870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2056e4c9-19e7-49db-b377-a341243c31d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35af5fb664c043faa62acf8e5be03c0a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:29.015437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1211/2392] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:03:28 2022] DELETE /identity/v3/users/35af5fb664c043faa62acf8e5be03c0a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:29.195168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1379-1ab6-4dd8-880d-3280b40e6860 service swift] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:29.207685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1379-1ab6-4dd8-880d-3280b40e6860 service swift] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:29.268121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:29.268744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.269016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.269279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] PATH_INFO: `/v3/projects/cd6bb722d9b949e081c491ffeae2ba7e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.270410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6bb722d9b949e081c491ffeae2ba7e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:29.272593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:29.328737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6bb722d9b949e081c491ffeae2ba7e', 'request_id': 'req-3815d055-df50-4703-a80f-47d87aff6ce1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:29.336730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6bb722d9b949e081c491ffeae2ba7e', 'request_id': 'req-3815d055-df50-4703-a80f-47d87aff6ce1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:29.344829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6bb722d9b949e081c491ffeae2ba7e', 'request_id': 'req-3815d055-df50-4703-a80f-47d87aff6ce1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:29.356450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] The token cache is being invalidate because project cd6bb722d9b949e081c491ffeae2ba7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:03:29.356732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:29.357369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-3815d055-df50-4703-a80f-47d87aff6ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:29.358840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1182/2393] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:03:29 2022] DELETE /identity/v3/projects/cd6bb722d9b949e081c491ffeae2ba7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:29.363761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60eb9-a152-4de6-b9cf-334bb60622a6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.364045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60eb9-a152-4de6-b9cf-334bb60622a6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.364319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60eb9-a152-4de6-b9cf-334bb60622a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.384454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f3f60eb9-a152-4de6-b9cf-334bb60622a6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:29.385932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f3f60eb9-a152-4de6-b9cf-334bb60622a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:29.409959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:29.453221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1212/2394] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:29.461844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f29b-2718-46f8-ab00-8fbac7d2fbb5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.462167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f29b-2718-46f8-ab00-8fbac7d2fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.462435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f29b-2718-46f8-ab00-8fbac7d2fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.484108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dd98f29b-2718-46f8-ab00-8fbac7d2fbb5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:29.485332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dd98f29b-2718-46f8-ab00-8fbac7d2fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:29.493352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1183/2395] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:29.497680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60eb9-a152-4de6-b9cf-334bb60622a6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:29.507343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60eb9-a152-4de6-b9cf-334bb60622a6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:29.512698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:29.513279 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.513556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.513823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.514463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:03:29.514784 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:29.516360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:29.528311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1213/2396] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:03:29.532393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98f29b-2718-46f8-ab00-8fbac7d2fbb5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:29.541565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98f29b-2718-46f8-ab00-8fbac7d2fbb5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:29.546124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406980e-d4e9-4d5c-88ad-deb4006af9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:29.546698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406980e-d4e9-4d5c-88ad-deb4006af9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.547001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406980e-d4e9-4d5c-88ad-deb4006af9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.547265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406980e-d4e9-4d5c-88ad-deb4006af9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.547877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406980e-d4e9-4d5c-88ad-deb4006af9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:29.549768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406980e-d4e9-4d5c-88ad-deb4006af9bf admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:29.563478 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:29.581803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1184/2397] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:03:29 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:29.586025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:29.596223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6488f5-36a9-4355-b444-28ab531b307b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:29.658658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01be70-e4d6-4f3a-a98f-0562aaa123d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:29.659288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01be70-e4d6-4f3a-a98f-0562aaa123d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.659563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01be70-e4d6-4f3a-a98f-0562aaa123d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.659829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01be70-e4d6-4f3a-a98f-0562aaa123d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.660488 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01be70-e4d6-4f3a-a98f-0562aaa123d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:29.663154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01be70-e4d6-4f3a-a98f-0562aaa123d5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:29.685324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1214/2398] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:03:29 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:29.689639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406980e-d4e9-4d5c-88ad-deb4006af9bf admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:29.701765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406980e-d4e9-4d5c-88ad-deb4006af9bf admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:29.706384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b3c3b-7c01-4364-a0f3-f8f00b11611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:29.707005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3c3b-7c01-4364-a0f3-f8f00b11611a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.707285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3c3b-7c01-4364-a0f3-f8f00b11611a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.707549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3c3b-7c01-4364-a0f3-f8f00b11611a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.708217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b3c3b-7c01-4364-a0f3-f8f00b11611a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:29.709800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b3c3b-7c01-4364-a0f3-f8f00b11611a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:29.720046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1185/2399] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:03:29.724109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01be70-e4d6-4f3a-a98f-0562aaa123d5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:29.734490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01be70-e4d6-4f3a-a98f-0562aaa123d5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:29.739106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e925e43-9488-474c-a238-a79b1c4bfe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:29.739707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e925e43-9488-474c-a238-a79b1c4bfe28 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.739979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e925e43-9488-474c-a238-a79b1c4bfe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.740243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e925e43-9488-474c-a238-a79b1c4bfe28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.740869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e925e43-9488-474c-a238-a79b1c4bfe28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:29.743256 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e925e43-9488-474c-a238-a79b1c4bfe28 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:29.753724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1215/2400] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:03:29.759292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b3c3b-7c01-4364-a0f3-f8f00b11611a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:29.770349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b3c3b-7c01-4364-a0f3-f8f00b11611a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:29.775458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:29.776128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.776401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.776665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] PATH_INFO: `/v3/projects/db69f54ebd8d4bd280fd1d9d10106238/users/911e67cabf7f49d79b28a5779d3eaa2d/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.790954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db69f54ebd8d4bd280fd1d9d10106238, user_id=911e67cabf7f49d79b28a5779d3eaa2d, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:29.793573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:29.807046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1186/2401] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:03:29 2022] PUT /identity/v3/projects/db69f54ebd8d4bd280fd1d9d10106238/users/911e67cabf7f49d79b28a5779d3eaa2d/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:29.817937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5debf4-7d0e-4fce-bd20-62efeb29a378 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.818245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5debf4-7d0e-4fce-bd20-62efeb29a378 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.818522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5debf4-7d0e-4fce-bd20-62efeb29a378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:29.848549 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0d5debf4-7d0e-4fce-bd20-62efeb29a378 None None] MFA Rules not processed for user `911e67cabf7f49d79b28a5779d3eaa2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:29.849684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0d5debf4-7d0e-4fce-bd20-62efeb29a378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:29.916001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1216/2402] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:03:29.927122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:29.928916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:29.994359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235eb47-8dae-4de3-b722-049b54a1194d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:29.998191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e469f15-ef96-4da2-9ef4-9e990c732875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:29.998811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e469f15-ef96-4da2-9ef4-9e990c732875 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:29.999081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e469f15-ef96-4da2-9ef4-9e990c732875 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:29.999346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e469f15-ef96-4da2-9ef4-9e990c732875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:30.007671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e469f15-ef96-4da2-9ef4-9e990c732875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:30.009575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e469f15-ef96-4da2-9ef4-9e990c732875 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:30.019710 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1187/2403] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:39.912269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:40.015197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:40.134795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5debf4-7d0e-4fce-bd20-62efeb29a378 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:40.200415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5debf4-7d0e-4fce-bd20-62efeb29a378 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:40.204786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:40.205409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:40.205687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:40.205971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] PATH_INFO: `/v3/users/911e67cabf7f49d79b28a5779d3eaa2d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:40.207106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=911e67cabf7f49d79b28a5779d3eaa2d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:40.209032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:40.255403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911e67cabf7f49d79b28a5779d3eaa2d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.264221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911e67cabf7f49d79b28a5779d3eaa2d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.265065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911e67cabf7f49d79b28a5779d3eaa2d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.265797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911e67cabf7f49d79b28a5779d3eaa2d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.273688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911e67cabf7f49d79b28a5779d3eaa2d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.290578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1217/2404] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:03:40 2022] DELETE /identity/v3/users/911e67cabf7f49d79b28a5779d3eaa2d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:40.295042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb67a-b2ab-4c88-9ed7-8e4eaca8344a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:40.295327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb67a-b2ab-4c88-9ed7-8e4eaca8344a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:40.295600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb67a-b2ab-4c88-9ed7-8e4eaca8344a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:40.314379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ac5eb67a-b2ab-4c88-9ed7-8e4eaca8344a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:40.315756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ac5eb67a-b2ab-4c88-9ed7-8e4eaca8344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:40.375730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1188/2405] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:40.387656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:40.389977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:40.447693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a15643-12d4-4045-9e72-81733a086eed admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:40.451959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30adfa0-5d8f-48f5-8985-cd6a60a66d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:40.452520 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30adfa0-5d8f-48f5-8985-cd6a60a66d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:40.452801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30adfa0-5d8f-48f5-8985-cd6a60a66d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:40.453071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30adfa0-5d8f-48f5-8985-cd6a60a66d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:40.463066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30adfa0-5d8f-48f5-8985-cd6a60a66d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:40.464482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30adfa0-5d8f-48f5-8985-cd6a60a66d29 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:40.473878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1218/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:40.749247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eb67a-b2ab-4c88-9ed7-8e4eaca8344a None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:40.750772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ac5eb67a-b2ab-4c88-9ed7-8e4eaca8344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:40.766177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eb67a-b2ab-4c88-9ed7-8e4eaca8344a None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:40.772251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:40.773082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:40.774011 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:40.774257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] PATH_INFO: `/v3/projects/db69f54ebd8d4bd280fd1d9d10106238` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:40.775421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db69f54ebd8d4bd280fd1d9d10106238)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:40.777381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:40.823101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db69f54ebd8d4bd280fd1d9d10106238', 'request_id': 'req-352e0929-9663-4acb-b493-81be9ed5d651'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.828463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db69f54ebd8d4bd280fd1d9d10106238', 'request_id': 'req-352e0929-9663-4acb-b493-81be9ed5d651'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.837854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db69f54ebd8d4bd280fd1d9d10106238', 'request_id': 'req-352e0929-9663-4acb-b493-81be9ed5d651'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.849337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] The token cache is being invalidate because project db69f54ebd8d4bd280fd1d9d10106238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:03:40.849623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.850241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-352e0929-9663-4acb-b493-81be9ed5d651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:40.856347 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1189/2407] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:03:40 2022] DELETE /identity/v3/projects/db69f54ebd8d4bd280fd1d9d10106238 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:40.861384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48e2e-8c87-4074-9846-6ce135822b86 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:40.861670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48e2e-8c87-4074-9846-6ce135822b86 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:40.861947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48e2e-8c87-4074-9846-6ce135822b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:40.881669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2bb48e2e-8c87-4074-9846-6ce135822b86 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:40.883046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2bb48e2e-8c87-4074-9846-6ce135822b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:40.906902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:40.952481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1219/2408] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:03:40.960339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f911-4d58-4e74-80b0-f14efb68be8d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:40.960623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f911-4d58-4e74-80b0-f14efb68be8d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:40.961430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f911-4d58-4e74-80b0-f14efb68be8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:40.981462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-02a6f911-4d58-4e74-80b0-f14efb68be8d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:40.982663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-02a6f911-4d58-4e74-80b0-f14efb68be8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:40.990554 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1190/2409] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:40.994737 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb48e2e-8c87-4074-9846-6ce135822b86 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:41.004598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb48e2e-8c87-4074-9846-6ce135822b86 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:41.009272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:41.010113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:41.010395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:41.010662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:41.011338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:03:41.011640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:41.013211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:41.025712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1220/2410] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:03:41.029921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f911-4d58-4e74-80b0-f14efb68be8d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:41.039874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f911-4d58-4e74-80b0-f14efb68be8d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:41.044645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89f20a-1849-438e-acfb-5cf8c5a624ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:41.045228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f20a-1849-438e-acfb-5cf8c5a624ff admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:41.045502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f20a-1849-438e-acfb-5cf8c5a624ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:41.045769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f20a-1849-438e-acfb-5cf8c5a624ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:41.046402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89f20a-1849-438e-acfb-5cf8c5a624ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:41.048342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89f20a-1849-438e-acfb-5cf8c5a624ff admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:41.074617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1191/2411] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:03:41 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:41.078638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:41.089178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d439a-3b44-4aa3-a370-cf30f797273d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:41.146704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f8e0-32b4-4396-8e06-f133fd695f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:41.147336 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f8e0-32b4-4396-8e06-f133fd695f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:41.147634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f8e0-32b4-4396-8e06-f133fd695f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:41.147903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f8e0-32b4-4396-8e06-f133fd695f0c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:41.149309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f8e0-32b4-4396-8e06-f133fd695f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:41.151234 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f8e0-32b4-4396-8e06-f133fd695f0c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:41.174561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1221/2412] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:03:41 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:41.175775 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89f20a-1849-438e-acfb-5cf8c5a624ff admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:41.186297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89f20a-1849-438e-acfb-5cf8c5a624ff admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:41.190829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49b01-d8c3-4fc7-8e4c-5369e28de97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:41.191407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49b01-d8c3-4fc7-8e4c-5369e28de97b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:41.191680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49b01-d8c3-4fc7-8e4c-5369e28de97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:41.191944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49b01-d8c3-4fc7-8e4c-5369e28de97b admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:41.192578 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a49b01-d8c3-4fc7-8e4c-5369e28de97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:41.194145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a49b01-d8c3-4fc7-8e4c-5369e28de97b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:41.204455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1192/2413] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:03:41.208313 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f8e0-32b4-4396-8e06-f133fd695f0c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:41.218461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f8e0-32b4-4396-8e06-f133fd695f0c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:41.223267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2933c-4761-4c0e-aef6-d88b29d0198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:41.223845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2933c-4761-4c0e-aef6-d88b29d0198b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:41.224117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2933c-4761-4c0e-aef6-d88b29d0198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:41.224385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2933c-4761-4c0e-aef6-d88b29d0198b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:41.225007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2933c-4761-4c0e-aef6-d88b29d0198b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:41.226614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2933c-4761-4c0e-aef6-d88b29d0198b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:41.236832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1222/2414] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:03:41.240901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49b01-d8c3-4fc7-8e4c-5369e28de97b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:41.251038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49b01-d8c3-4fc7-8e4c-5369e28de97b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:41.255635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:41.256263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:41.256537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:41.256803 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] PATH_INFO: `/v3/projects/b801b0abbad24aa4a3fb502a00f5fee1/users/7afbe858bd4c49ab9d7c2dbaed62aa6f/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:41.271774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b801b0abbad24aa4a3fb502a00f5fee1, user_id=7afbe858bd4c49ab9d7c2dbaed62aa6f, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:41.275023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:41.287625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1193/2415] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:03:41 2022] PUT /identity/v3/projects/b801b0abbad24aa4a3fb502a00f5fee1/users/7afbe858bd4c49ab9d7c2dbaed62aa6f/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:41.292669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a67e-9600-4246-88e2-f8ef6c810e55 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:41.292976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a67e-9600-4246-88e2-f8ef6c810e55 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:41.293245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a67e-9600-4246-88e2-f8ef6c810e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:41.311905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0427a67e-9600-4246-88e2-f8ef6c810e55 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:41.313086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0427a67e-9600-4246-88e2-f8ef6c810e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:41.373217 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1223/2416] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:03:41.383298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:41.385521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:41.408419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:41.444714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9da8-06a6-49f3-90f5-7e6ad1676b18 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:41.449032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02988f-95f0-41f0-8b62-c6a877e7d648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:41.449617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02988f-95f0-41f0-8b62-c6a877e7d648 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:41.449888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02988f-95f0-41f0-8b62-c6a877e7d648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:41.450153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02988f-95f0-41f0-8b62-c6a877e7d648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:41.458829 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02988f-95f0-41f0-8b62-c6a877e7d648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:41.460237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02988f-95f0-41f0-8b62-c6a877e7d648 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:41.470199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1194/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:45.436667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359274b-7fd2-46a3-8414-78e57834ec30 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:45.437200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359274b-7fd2-46a3-8414-78e57834ec30 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:45.437200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359274b-7fd2-46a3-8414-78e57834ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:45.467461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8359274b-7fd2-46a3-8414-78e57834ec30 None None] MFA Rules not processed for user `7afbe858bd4c49ab9d7c2dbaed62aa6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:45.468842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8359274b-7fd2-46a3-8414-78e57834ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:45.486532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:45.544979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1224/2418] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:45.549608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02988f-95f0-41f0-8b62-c6a877e7d648 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:45.563163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02988f-95f0-41f0-8b62-c6a877e7d648 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:45.569533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b99a6-b634-45b9-976f-197437312a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:45.571538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b99a6-b634-45b9-976f-197437312a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:45.571924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b99a6-b634-45b9-976f-197437312a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:45.572298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b99a6-b634-45b9-976f-197437312a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:45.573473 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b99a6-b634-45b9-976f-197437312a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:45.575650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b99a6-b634-45b9-976f-197437312a89 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:45.617540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1195/2419] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:03:45 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:45.621566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359274b-7fd2-46a3-8414-78e57834ec30 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:45.652982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359274b-7fd2-46a3-8414-78e57834ec30 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:45.752062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e577-8305-4b5a-8f75-f8999bf1aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:45.752754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e577-8305-4b5a-8f75-f8999bf1aeee admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:45.753121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e577-8305-4b5a-8f75-f8999bf1aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:45.754074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e577-8305-4b5a-8f75-f8999bf1aeee admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:45.755030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e577-8305-4b5a-8f75-f8999bf1aeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:45.757043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e577-8305-4b5a-8f75-f8999bf1aeee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:45.786134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1225/2420] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:03:45 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:45.790814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b99a6-b634-45b9-976f-197437312a89 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:45.806165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b99a6-b634-45b9-976f-197437312a89 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:45.812867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ba68-24c5-4ee3-b17e-1e0097e748fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:45.813702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ba68-24c5-4ee3-b17e-1e0097e748fe admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:45.814150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ba68-24c5-4ee3-b17e-1e0097e748fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:45.814912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ba68-24c5-4ee3-b17e-1e0097e748fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:45.815749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9ba68-24c5-4ee3-b17e-1e0097e748fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:45.817834 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9ba68-24c5-4ee3-b17e-1e0097e748fe admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:45.834680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1196/2421] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:03:45.839182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e577-8305-4b5a-8f75-f8999bf1aeee admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:45.852696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e577-8305-4b5a-8f75-f8999bf1aeee admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:45.857920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd288-b65c-4ae8-bf92-2cea5e4621c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:45.858588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd288-b65c-4ae8-bf92-2cea5e4621c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:45.858919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd288-b65c-4ae8-bf92-2cea5e4621c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:45.859232 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd288-b65c-4ae8-bf92-2cea5e4621c1 admin admin] PATH_INFO: `/v3/projects/a686d3ab24f04bb2b0f177744615a4d7/users/f38eeedfb34e40d79f3d89582de80d28/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:45.878465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd288-b65c-4ae8-bf92-2cea5e4621c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a686d3ab24f04bb2b0f177744615a4d7, user_id=f38eeedfb34e40d79f3d89582de80d28, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:45.881207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd288-b65c-4ae8-bf92-2cea5e4621c1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:45.900774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1226/2422] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:03:45 2022] PUT /identity/v3/projects/a686d3ab24f04bb2b0f177744615a4d7/users/f38eeedfb34e40d79f3d89582de80d28/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:45.904659 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ba68-24c5-4ee3-b17e-1e0097e748fe admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:45.916807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ba68-24c5-4ee3-b17e-1e0097e748fe admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:46.013051 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:46.013592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:46.013902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:46.014193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:46.015129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:46.016771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:46.031357 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1197/2423] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:03:46.035393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd288-b65c-4ae8-bf92-2cea5e4621c1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:46.054133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd288-b65c-4ae8-bf92-2cea5e4621c1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:46.099357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144337-2660-418d-a40a-060b24afd129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:46.100437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144337-2660-418d-a40a-060b24afd129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:46.100936 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144337-2660-418d-a40a-060b24afd129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:46.101508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144337-2660-418d-a40a-060b24afd129 admin admin] PATH_INFO: `/v3/projects/a686d3ab24f04bb2b0f177744615a4d7/users/f38eeedfb34e40d79f3d89582de80d28/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:46.104623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144337-2660-418d-a40a-060b24afd129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a686d3ab24f04bb2b0f177744615a4d7, user_id=f38eeedfb34e40d79f3d89582de80d28, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:46.111424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144337-2660-418d-a40a-060b24afd129 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:46.143841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1227/2424] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:03:46 2022] PUT /identity/v3/projects/a686d3ab24f04bb2b0f177744615a4d7/users/f38eeedfb34e40d79f3d89582de80d28/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:50.551823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:50.554388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:50.575458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9395-456b-4c8b-9763-455f93c7491a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:50.673069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:50.674611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:50.675345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:50.675837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] PATH_INFO: `/v3/users/42108d6d996840c48288d86e181a77a9` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:50.677799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42108d6d996840c48288d86e181a77a9)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:50.680491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:50.720325 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:50.748716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42108d6d996840c48288d86e181a77a9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:50.759282 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42108d6d996840c48288d86e181a77a9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:50.759894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42108d6d996840c48288d86e181a77a9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:50.761222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42108d6d996840c48288d86e181a77a9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:50.774882 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42108d6d996840c48288d86e181a77a9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:50.796767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1198/2425] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:03:50 2022] DELETE /identity/v3/users/42108d6d996840c48288d86e181a77a9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:50.807231 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875105b-567a-4a23-a432-e00aa9553c62 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:50.808477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875105b-567a-4a23-a432-e00aa9553c62 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:50.809030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875105b-567a-4a23-a432-e00aa9553c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:50.832493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1875105b-567a-4a23-a432-e00aa9553c62 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:50.833708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1875105b-567a-4a23-a432-e00aa9553c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:50.929066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1228/2426] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:03:50.939441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:50.946687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.037497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641917a-b2cf-4e69-bf2d-c66cbe73a39f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:51.042919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:51.043799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.044170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.044533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.057740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:51.059392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:51.075556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1199/2427] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:51.103955 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e39e6c-1189-4e00-b2c2-0ffb16085cb4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.105110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e39e6c-1189-4e00-b2c2-0ffb16085cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.105581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e39e6c-1189-4e00-b2c2-0ffb16085cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.157592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:51.171446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b7e39e6c-1189-4e00-b2c2-0ffb16085cb4 None None] MFA Rules not processed for user `f38eeedfb34e40d79f3d89582de80d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:51.173662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b7e39e6c-1189-4e00-b2c2-0ffb16085cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.290036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1229/2428] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:51.304090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:51.306329 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.379271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c159e-43c9-458d-b40f-af12bda10ef5 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:51.384442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574a4d6-b539-434b-b05a-90f831794c39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:51.385586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574a4d6-b539-434b-b05a-90f831794c39 service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.386096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574a4d6-b539-434b-b05a-90f831794c39 service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.386577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574a4d6-b539-434b-b05a-90f831794c39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.388730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0574a4d6-b539-434b-b05a-90f831794c39 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.439893 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e39e6c-1189-4e00-b2c2-0ffb16085cb4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:51.441353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b7e39e6c-1189-4e00-b2c2-0ffb16085cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.461406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e39e6c-1189-4e00-b2c2-0ffb16085cb4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:51.475178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:51.475828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.476094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.476454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] PATH_INFO: `/v3/projects/3737c60ed18c4072af042cb544a6c237` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.479125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3737c60ed18c4072af042cb544a6c237)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:51.481083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:51.486076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574a4d6-b539-434b-b05a-90f831794c39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:51.487555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574a4d6-b539-434b-b05a-90f831794c39 service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:51.507008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1200/2429] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:51.560144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3737c60ed18c4072af042cb544a6c237', 'request_id': 'req-3ebe5c88-0e12-4354-a67b-3d0087737c39'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:51.565964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3737c60ed18c4072af042cb544a6c237', 'request_id': 'req-3ebe5c88-0e12-4354-a67b-3d0087737c39'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:51.574420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3737c60ed18c4072af042cb544a6c237', 'request_id': 'req-3ebe5c88-0e12-4354-a67b-3d0087737c39'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:51.587278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] The token cache is being invalidate because project 3737c60ed18c4072af042cb544a6c237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:03:51.588385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:51.589180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ebe5c88-0e12-4354-a67b-3d0087737c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:51.591013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1230/2430] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:03:51 2022] DELETE /identity/v3/projects/3737c60ed18c4072af042cb544a6c237 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:03:51.595894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667b78-2f57-4f39-8520-2b1a68241f59 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.596378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667b78-2f57-4f39-8520-2b1a68241f59 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.596471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667b78-2f57-4f39-8520-2b1a68241f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.614462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:51.627569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1f667b78-2f57-4f39-8520-2b1a68241f59 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:51.629331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1f667b78-2f57-4f39-8520-2b1a68241f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.678028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c81f7-1ddd-461e-9412-57745eaa3baf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.678567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c81f7-1ddd-461e-9412-57745eaa3baf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.678895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c81f7-1ddd-461e-9412-57745eaa3baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.721405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1201/2431] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:51.732152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb574961-ce6b-4f68-9032-c219d2a3b285 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.732641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb574961-ce6b-4f68-9032-c219d2a3b285 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.733092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb574961-ce6b-4f68-9032-c219d2a3b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.746263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-372c81f7-1ddd-461e-9412-57745eaa3baf None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:51.747658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-372c81f7-1ddd-461e-9412-57745eaa3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.753694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bb574961-ce6b-4f68-9032-c219d2a3b285 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:51.754890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bb574961-ce6b-4f68-9032-c219d2a3b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.771125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1202/2432] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:51.775373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb574961-ce6b-4f68-9032-c219d2a3b285 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:51.784748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb574961-ce6b-4f68-9032-c219d2a3b285 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:51.790156 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:51.791150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.791452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.791721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.792373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:03:51.792671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:51.794270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:51.808031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1203/2433] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:03:51.812349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:51.823402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1231/2434] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:03:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:03:51.824461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062b9f7-7071-45d9-b109-64a88b9d9594 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:51.830062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e65c6c-3ec0-4a31-a951-00cc930b4956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:51.830679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65c6c-3ec0-4a31-a951-00cc930b4956 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.831032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65c6c-3ec0-4a31-a951-00cc930b4956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.831401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65c6c-3ec0-4a31-a951-00cc930b4956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.832704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e65c6c-3ec0-4a31-a951-00cc930b4956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:51.834332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e65c6c-3ec0-4a31-a951-00cc930b4956 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:51.837649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c81f7-1ddd-461e-9412-57745eaa3baf None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:51.839103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-372c81f7-1ddd-461e-9412-57745eaa3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:51.868374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1204/2435] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:03:51 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:51.872800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e65c6c-3ec0-4a31-a951-00cc930b4956 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:51.875517 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:51.935405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c81f7-1ddd-461e-9412-57745eaa3baf None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:51.960421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e65c6c-3ec0-4a31-a951-00cc930b4956 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:51.966338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2b3b-529f-49db-b55f-99816678cac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:51.967096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2b3b-529f-49db-b55f-99816678cac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:51.967433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2b3b-529f-49db-b55f-99816678cac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:51.967709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2b3b-529f-49db-b55f-99816678cac4 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:51.968344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec2b3b-529f-49db-b55f-99816678cac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:51.970266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec2b3b-529f-49db-b55f-99816678cac4 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:51.994396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1205/2436] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:03:51 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:03:51.998706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2b3b-529f-49db-b55f-99816678cac4 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:52.005899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf69d5f-13b9-46b5-a7e5-9785e18c473c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:52.006510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69d5f-13b9-46b5-a7e5-9785e18c473c service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.006818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69d5f-13b9-46b5-a7e5-9785e18c473c service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.007089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69d5f-13b9-46b5-a7e5-9785e18c473c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:52.010523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2b3b-529f-49db-b55f-99816678cac4 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:52.015408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b453c7-c627-4371-aaab-4061d863ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:52.016012 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b453c7-c627-4371-aaab-4061d863ddfb admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.016316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b453c7-c627-4371-aaab-4061d863ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.016585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b453c7-c627-4371-aaab-4061d863ddfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:52.017257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b453c7-c627-4371-aaab-4061d863ddfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:52.019337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b453c7-c627-4371-aaab-4061d863ddfb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:52.031418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1206/2437] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:03:52.035494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b453c7-c627-4371-aaab-4061d863ddfb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:52.048762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b453c7-c627-4371-aaab-4061d863ddfb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:52.060072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055e55-12b2-4860-8f7e-87d9cb20748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:52.060733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055e55-12b2-4860-8f7e-87d9cb20748b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.061008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055e55-12b2-4860-8f7e-87d9cb20748b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.061680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055e55-12b2-4860-8f7e-87d9cb20748b admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:52.063943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055e55-12b2-4860-8f7e-87d9cb20748b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:52.069155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055e55-12b2-4860-8f7e-87d9cb20748b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:52.075894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf69d5f-13b9-46b5-a7e5-9785e18c473c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:52.077888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf69d5f-13b9-46b5-a7e5-9785e18c473c service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:52.085433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1207/2438] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:03:52.090153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055e55-12b2-4860-8f7e-87d9cb20748b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:52.090382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1232/2439] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:03:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 05:03:52.101052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055e55-12b2-4860-8f7e-87d9cb20748b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:52.107457 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:52.108138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.108417 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.108690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] PATH_INFO: `/v3/projects/ff1695d89a5f44c18dd5ab536617282f/users/32d6ca74e3c44f37a22160f8ca861742/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:52.131107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1695d89a5f44c18dd5ab536617282f, user_id=32d6ca74e3c44f37a22160f8ca861742, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:52.134293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:52.170074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1208/2440] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:03:52 2022] PUT /identity/v3/projects/ff1695d89a5f44c18dd5ab536617282f/users/32d6ca74e3c44f37a22160f8ca861742/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:03:52.175628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f796d11-c0df-483e-a7c5-382bd3e603dd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.175925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f796d11-c0df-483e-a7c5-382bd3e603dd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.176195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f796d11-c0df-483e-a7c5-382bd3e603dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:52.209713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4f796d11-c0df-483e-a7c5-382bd3e603dd None None] MFA Rules not processed for user `32d6ca74e3c44f37a22160f8ca861742`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:52.211420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4f796d11-c0df-483e-a7c5-382bd3e603dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:52.295198 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:52.306045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1233/2441] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:52.317110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:52.322300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:52.330232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:52.428193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767859-46f8-49ac-9184-7e6eb0260785 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:52.432995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ec7b-a666-49e6-b3aa-84d5bc769aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:52.433736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ec7b-a666-49e6-b3aa-84d5bc769aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.434008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ec7b-a666-49e6-b3aa-84d5bc769aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.434277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ec7b-a666-49e6-b3aa-84d5bc769aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:52.447432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ec7b-a666-49e6-b3aa-84d5bc769aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:52.449034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ec7b-a666-49e6-b3aa-84d5bc769aa5 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:52.461978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1209/2442] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:52.490556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f796d11-c0df-483e-a7c5-382bd3e603dd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:52.613810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f796d11-c0df-483e-a7c5-382bd3e603dd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:52.628628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:52.629906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.634379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.634737 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] PATH_INFO: `/v3/users/32d6ca74e3c44f37a22160f8ca861742` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:52.636567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d6ca74e3c44f37a22160f8ca861742)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:52.639460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:52.704753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d6ca74e3c44f37a22160f8ca861742'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:52.714611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d6ca74e3c44f37a22160f8ca861742'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:52.715581 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d6ca74e3c44f37a22160f8ca861742'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:52.716470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d6ca74e3c44f37a22160f8ca861742'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:52.729294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d6ca74e3c44f37a22160f8ca861742'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:52.758547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1234/2443] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:03:52 2022] DELETE /identity/v3/users/32d6ca74e3c44f37a22160f8ca861742 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:52.760812 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc92c6-8d4a-4829-8546-806df2b6512f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.761316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc92c6-8d4a-4829-8546-806df2b6512f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.761413 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc92c6-8d4a-4829-8546-806df2b6512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:52.793666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-03bc92c6-8d4a-4829-8546-806df2b6512f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:52.797679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-03bc92c6-8d4a-4829-8546-806df2b6512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:52.874144 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1210/2444] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:52.885836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:52.887898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:52.990305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ffb9-8c15-4ea9-a279-28fc725d4b56 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:52.995727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a18dd9-d10c-4fa1-b7d1-950f75bbc560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:52.996476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18dd9-d10c-4fa1-b7d1-950f75bbc560 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:52.996860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18dd9-d10c-4fa1-b7d1-950f75bbc560 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:52.997242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18dd9-d10c-4fa1-b7d1-950f75bbc560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:53.011600 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a18dd9-d10c-4fa1-b7d1-950f75bbc560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:53.013440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a18dd9-d10c-4fa1-b7d1-950f75bbc560 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:53.026553 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1235/2445] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:03:53.477131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc92c6-8d4a-4829-8546-806df2b6512f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:53.479533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-03bc92c6-8d4a-4829-8546-806df2b6512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:53.499661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc92c6-8d4a-4829-8546-806df2b6512f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:53.506535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:53.507895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:53.508997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:53.508997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] PATH_INFO: `/v3/projects/ff1695d89a5f44c18dd5ab536617282f` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:53.512786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1695d89a5f44c18dd5ab536617282f)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:53.514734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:53.584858 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1695d89a5f44c18dd5ab536617282f', 'request_id': 'req-64f27e0f-bfac-4400-84cf-bacbff459e8f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:53.593339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1695d89a5f44c18dd5ab536617282f', 'request_id': 'req-64f27e0f-bfac-4400-84cf-bacbff459e8f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:53.607999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1695d89a5f44c18dd5ab536617282f', 'request_id': 'req-64f27e0f-bfac-4400-84cf-bacbff459e8f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:53.632381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] The token cache is being invalidate because project ff1695d89a5f44c18dd5ab536617282f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:03:53.633356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:53.634099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-64f27e0f-bfac-4400-84cf-bacbff459e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:03:53.642798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1211/2446] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:03:53 2022] DELETE /identity/v3/projects/ff1695d89a5f44c18dd5ab536617282f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:53.644880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c77c5-1109-4633-8d0b-c50a76f36faa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:53.647587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c77c5-1109-4633-8d0b-c50a76f36faa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:53.648053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c77c5-1109-4633-8d0b-c50a76f36faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:53.678374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-226c77c5-1109-4633-8d0b-c50a76f36faa None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:53.685150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-226c77c5-1109-4633-8d0b-c50a76f36faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:53.770970 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:53.873560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1236/2447] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:53.881693 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1f5bc-908c-4a4f-97c3-e6364ae139c8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:53.882241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1f5bc-908c-4a4f-97c3-e6364ae139c8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:53.882241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1f5bc-908c-4a4f-97c3-e6364ae139c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:53.910194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dbd1f5bc-908c-4a4f-97c3-e6364ae139c8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:53.911456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dbd1f5bc-908c-4a4f-97c3-e6364ae139c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:53.920280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1212/2448] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:03:53.924596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c77c5-1109-4633-8d0b-c50a76f36faa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:53.935621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c77c5-1109-4633-8d0b-c50a76f36faa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:53.940863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:53.941481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:53.941758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:53.942034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:53.942690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:03:53.943048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:53.944736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:53.958642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1237/2449] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:03:53.963530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1f5bc-908c-4a4f-97c3-e6364ae139c8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:53.974260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1f5bc-908c-4a4f-97c3-e6364ae139c8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:53.987016 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8196d6-3730-48f7-a106-99e61f92efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:53.988687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8196d6-3730-48f7-a106-99e61f92efbf admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:53.988687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8196d6-3730-48f7-a106-99e61f92efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:53.988687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8196d6-3730-48f7-a106-99e61f92efbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:53.988985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8196d6-3730-48f7-a106-99e61f92efbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:53.990781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8196d6-3730-48f7-a106-99e61f92efbf admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:54.053947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1213/2450] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:03:53 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:03:54.058296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:54.071492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca3687-b4bd-4b44-a27f-cb5f845eb824 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:54.182718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b0ff-b25a-4aa0-b036-cda9dea72044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:54.183362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b0ff-b25a-4aa0-b036-cda9dea72044 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:54.183643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b0ff-b25a-4aa0-b036-cda9dea72044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:54.183917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b0ff-b25a-4aa0-b036-cda9dea72044 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:54.184561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021b0ff-b25a-4aa0-b036-cda9dea72044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:54.186544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021b0ff-b25a-4aa0-b036-cda9dea72044 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:54.219011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1238/2451] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:03:54 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:03:54.223207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8196d6-3730-48f7-a106-99e61f92efbf admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:54.230836 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:54.244116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8196d6-3730-48f7-a106-99e61f92efbf admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:54.252708 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f512b6-5c78-45d9-b78d-1039356db303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:54.253335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f512b6-5c78-45d9-b78d-1039356db303 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:54.254182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f512b6-5c78-45d9-b78d-1039356db303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:54.254470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f512b6-5c78-45d9-b78d-1039356db303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:54.255628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f512b6-5c78-45d9-b78d-1039356db303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:54.257289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f512b6-5c78-45d9-b78d-1039356db303 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:54.279795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1214/2452] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:03:54.282113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b0ff-b25a-4aa0-b036-cda9dea72044 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:54.292805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b0ff-b25a-4aa0-b036-cda9dea72044 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:54.299297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93329105-fe36-4222-9382-5a9f37d722e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:54.300364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329105-fe36-4222-9382-5a9f37d722e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:54.301012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329105-fe36-4222-9382-5a9f37d722e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:54.301355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329105-fe36-4222-9382-5a9f37d722e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:54.302088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93329105-fe36-4222-9382-5a9f37d722e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:54.303963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93329105-fe36-4222-9382-5a9f37d722e2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:54.327376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1239/2453] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:03:54.331435 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f512b6-5c78-45d9-b78d-1039356db303 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:54.344827 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f512b6-5c78-45d9-b78d-1039356db303 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:54.350683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:54.352187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:54.352708 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:54.353199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] PATH_INFO: `/v3/projects/fe7ad970f320417ebe46fdbd34fab209/users/daf88c9d3f7545b9879d0cca427fc3d1/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:54.372892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7ad970f320417ebe46fdbd34fab209, user_id=daf88c9d3f7545b9879d0cca427fc3d1, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:54.376307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:54.404230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1215/2454] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:03:54 2022] PUT /identity/v3/projects/fe7ad970f320417ebe46fdbd34fab209/users/daf88c9d3f7545b9879d0cca427fc3d1/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:03:54.419214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5bf3-ac60-4832-b21c-d9dbf6cbfedd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:54.419636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5bf3-ac60-4832-b21c-d9dbf6cbfedd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:54.420009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5bf3-ac60-4832-b21c-d9dbf6cbfedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:54.480907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-89df5bf3-ac60-4832-b21c-d9dbf6cbfedd None None] MFA Rules not processed for user `daf88c9d3f7545b9879d0cca427fc3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:54.482615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-89df5bf3-ac60-4832-b21c-d9dbf6cbfedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:54.584427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1240/2455] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:03:54.599851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:54.601743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:54.717957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c02f8-6943-4fca-82ae-190f2f9d83c2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:54.727563 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:54.728481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:54.728960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:54.729579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:54.751261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:54.755673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:54.791609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1216/2456] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:03:56.497112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91238a9-b8c6-4e9d-94da-0796f041c714 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:56.497663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91238a9-b8c6-4e9d-94da-0796f041c714 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:56.497932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91238a9-b8c6-4e9d-94da-0796f041c714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:56.541334 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f91238a9-b8c6-4e9d-94da-0796f041c714 None None] MFA Rules not processed for user `daf88c9d3f7545b9879d0cca427fc3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:03:56.543381 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f91238a9-b8c6-4e9d-94da-0796f041c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:56.556601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1241/2457] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:03:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:03:57.543244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:03:57.545263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:57.691051 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07055b9f-7852-4892-a1b9-243675a74a11 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:03:57.703646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709bba8-3c4d-4762-acaa-862b5fab7dbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:03:57.704572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bba8-3c4d-4762-acaa-862b5fab7dbf service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:03:57.705035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bba8-3c4d-4762-acaa-862b5fab7dbf service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:03:57.706224 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bba8-3c4d-4762-acaa-862b5fab7dbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:03:57.708746 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d709bba8-3c4d-4762-acaa-862b5fab7dbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:03:57.724447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709bba8-3c4d-4762-acaa-862b5fab7dbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:03:57.726658 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709bba8-3c4d-4762-acaa-862b5fab7dbf service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:03:57.754340 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1217/2458] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:03:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:04:03.310847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c9609-9c7b-4d37-8fbb-6465639f786e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:03.311380 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c9609-9c7b-4d37-8fbb-6465639f786e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:03.311474 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c9609-9c7b-4d37-8fbb-6465639f786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:03.332896 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2f5c9609-9c7b-4d37-8fbb-6465639f786e None None] MFA Rules not processed for user `7afbe858bd4c49ab9d7c2dbaed62aa6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:03.334101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2f5c9609-9c7b-4d37-8fbb-6465639f786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:03.339476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:03.397196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1242/2459] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:04:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:05.763090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3015f-3f77-4b33-b544-f6cd138f36f8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:05.763657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3015f-3f77-4b33-b544-f6cd138f36f8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:05.763657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3015f-3f77-4b33-b544-f6cd138f36f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:05.810161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-67e3015f-3f77-4b33-b544-f6cd138f36f8 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:05.811671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-67e3015f-3f77-4b33-b544-f6cd138f36f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:05.916120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1218/2460] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:04:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:05.928305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c9609-9c7b-4d37-8fbb-6465639f786e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:05.930994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2f5c9609-9c7b-4d37-8fbb-6465639f786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:06.026415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c9609-9c7b-4d37-8fbb-6465639f786e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:06.032782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca88dc-d62f-432c-880e-8da2d27f20cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:06.033504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca88dc-d62f-432c-880e-8da2d27f20cc service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:06.033874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca88dc-d62f-432c-880e-8da2d27f20cc service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:06.034235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca88dc-d62f-432c-880e-8da2d27f20cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:06.043934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca88dc-d62f-432c-880e-8da2d27f20cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:06.045703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca88dc-d62f-432c-880e-8da2d27f20cc service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:06.055951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1243/2461] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:04:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:04:15.891052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:16.052071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=53 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:16.351621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3670025-607f-4941-bda4-53209c524e59 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:16.352425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3670025-607f-4941-bda4-53209c524e59 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:16.352550 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3670025-607f-4941-bda4-53209c524e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:16.373233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b3670025-607f-4941-bda4-53209c524e59 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:16.374970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b3670025-607f-4941-bda4-53209c524e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:16.382669 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1219/2462] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:04:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:16.407673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca88dc-d62f-432c-880e-8da2d27f20cc service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:16.418363 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca88dc-d62f-432c-880e-8da2d27f20cc service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:16.423910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1aff7-e65d-4bda-9238-4fb22731ab85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:16.424533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1aff7-e65d-4bda-9238-4fb22731ab85 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:16.424806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1aff7-e65d-4bda-9238-4fb22731ab85 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:16.425264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1aff7-e65d-4bda-9238-4fb22731ab85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:16.433939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1aff7-e65d-4bda-9238-4fb22731ab85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:16.435539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1aff7-e65d-4bda-9238-4fb22731ab85 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:16.443833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1244/2463] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:04:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:04:22.004355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf2176-7f62-4f84-9f25-5b6db3bbc126 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:22.005456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf2176-7f62-4f84-9f25-5b6db3bbc126 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:22.005942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf2176-7f62-4f84-9f25-5b6db3bbc126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:22.029781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d7cf2176-7f62-4f84-9f25-5b6db3bbc126 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:22.031074 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d7cf2176-7f62-4f84-9f25-5b6db3bbc126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:22.046117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1220/2464] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:04:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:22.053172 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1aff7-e65d-4bda-9238-4fb22731ab85 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:22.065568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1aff7-e65d-4bda-9238-4fb22731ab85 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:22.071516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6a851-25ab-479c-bbcd-74827e10f712 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:22.072133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a851-25ab-479c-bbcd-74827e10f712 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:22.072416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a851-25ab-479c-bbcd-74827e10f712 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:22.072683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a851-25ab-479c-bbcd-74827e10f712 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:22.082045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6a851-25ab-479c-bbcd-74827e10f712 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:22.083662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6a851-25ab-479c-bbcd-74827e10f712 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:22.093894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1245/2465] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:04:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:04:22.911687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75280386-afa0-47a3-b037-e3e67068c385 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:22.911974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75280386-afa0-47a3-b037-e3e67068c385 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:22.912254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75280386-afa0-47a3-b037-e3e67068c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:22.934822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-75280386-afa0-47a3-b037-e3e67068c385 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:22.936194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-75280386-afa0-47a3-b037-e3e67068c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:22.956705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1221/2466] 10.222.0.26 () {58 vars in 967 bytes} [Sat Sep 24 05:04:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:22.972124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6a851-25ab-479c-bbcd-74827e10f712 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:22.986478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6a851-25ab-479c-bbcd-74827e10f712 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:22.992307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14850d77-323c-446c-ae71-c3f6f736c38c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:22.993058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14850d77-323c-446c-ae71-c3f6f736c38c service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:22.993338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14850d77-323c-446c-ae71-c3f6f736c38c service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:22.993806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14850d77-323c-446c-ae71-c3f6f736c38c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:23.002977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14850d77-323c-446c-ae71-c3f6f736c38c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:23.004785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14850d77-323c-446c-ae71-c3f6f736c38c service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:23.015047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1246/2467] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:04:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:04:23.316997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc4a2-d2b9-4dc8-a353-290f3793c15a None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:23.317599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc4a2-d2b9-4dc8-a353-290f3793c15a None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:23.317599 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc4a2-d2b9-4dc8-a353-290f3793c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:23.338532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4acdc4a2-d2b9-4dc8-a353-290f3793c15a None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:23.339800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4acdc4a2-d2b9-4dc8-a353-290f3793c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:23.347378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1222/2468] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:04:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:23.366100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14850d77-323c-446c-ae71-c3f6f736c38c service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:23.378494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14850d77-323c-446c-ae71-c3f6f736c38c service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:23.384335 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36ac27-4d29-4af4-a6b8-303f2cd5c7f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:23.386059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36ac27-4d29-4af4-a6b8-303f2cd5c7f7 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:23.386059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36ac27-4d29-4af4-a6b8-303f2cd5c7f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:23.386059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36ac27-4d29-4af4-a6b8-303f2cd5c7f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:23.394886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36ac27-4d29-4af4-a6b8-303f2cd5c7f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:23.397230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36ac27-4d29-4af4-a6b8-303f2cd5c7f7 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:23.407884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1247/2469] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:04:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 05:04:23.955240 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea15b5-8ed8-4e81-a98b-a759803fba41 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:23.956304 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea15b5-8ed8-4e81-a98b-a759803fba41 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:23.956766 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea15b5-8ed8-4e81-a98b-a759803fba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:23.987600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-70ea15b5-8ed8-4e81-a98b-a759803fba41 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:23.989263 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-70ea15b5-8ed8-4e81-a98b-a759803fba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:24.003640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1223/2470] 10.222.0.26 () {58 vars in 967 bytes} [Sat Sep 24 05:04:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:04:24.011712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36ac27-4d29-4af4-a6b8-303f2cd5c7f7 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:24.026824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36ac27-4d29-4af4-a6b8-303f2cd5c7f7 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:24.031856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ea0b8-1125-4d1a-b742-da14d971a30d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:24.032701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea0b8-1125-4d1a-b742-da14d971a30d service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:24.033212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea0b8-1125-4d1a-b742-da14d971a30d service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:24.033697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea0b8-1125-4d1a-b742-da14d971a30d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:24.047841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ea0b8-1125-4d1a-b742-da14d971a30d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:24.049527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ea0b8-1125-4d1a-b742-da14d971a30d service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:24.064974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1248/2471] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:04:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:04:26.454311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea15b5-8ed8-4e81-a98b-a759803fba41 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:26.556250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea15b5-8ed8-4e81-a98b-a759803fba41 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:26.581099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:26.581881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:26.582215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:26.582686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] PATH_INFO: `/v3/users/daf88c9d3f7545b9879d0cca427fc3d1` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:26.583949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf88c9d3f7545b9879d0cca427fc3d1)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:26.586445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:26.736702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf88c9d3f7545b9879d0cca427fc3d1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:26.759543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf88c9d3f7545b9879d0cca427fc3d1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:26.760249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf88c9d3f7545b9879d0cca427fc3d1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:26.761157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf88c9d3f7545b9879d0cca427fc3d1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:26.770615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf88c9d3f7545b9879d0cca427fc3d1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:26.788568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1224/2472] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:04:26 2022] DELETE /identity/v3/users/daf88c9d3f7545b9879d0cca427fc3d1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:04:26.793289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f49a7-e0ce-44fa-b7f1-5d1608f5edfd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:26.793782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f49a7-e0ce-44fa-b7f1-5d1608f5edfd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:26.793887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f49a7-e0ce-44fa-b7f1-5d1608f5edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:26.814132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cb2f49a7-e0ce-44fa-b7f1-5d1608f5edfd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:26.815589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb2f49a7-e0ce-44fa-b7f1-5d1608f5edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:26.899870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1249/2473] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:26.909619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:26.911081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:26.972243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:26.980919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5a1af-90a9-4aa4-ae98-6a7e4c766b52 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:26.987808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:26.988590 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:26.988877 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:26.989150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:27.000331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:27.001770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:27.013620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1225/2474] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:04:27.231692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f49a7-e0ce-44fa-b7f1-5d1608f5edfd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:27.233212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb2f49a7-e0ce-44fa-b7f1-5d1608f5edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:27.272251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f49a7-e0ce-44fa-b7f1-5d1608f5edfd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:27.278670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:27.280346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:27.281099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:27.281658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] PATH_INFO: `/v3/projects/fe7ad970f320417ebe46fdbd34fab209` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:27.283470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7ad970f320417ebe46fdbd34fab209)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:27.285436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:27.361967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7ad970f320417ebe46fdbd34fab209', 'request_id': 'req-47034d71-79c5-49c2-82e7-a8c924523cde'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:27.370152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7ad970f320417ebe46fdbd34fab209', 'request_id': 'req-47034d71-79c5-49c2-82e7-a8c924523cde'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:27.380990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7ad970f320417ebe46fdbd34fab209', 'request_id': 'req-47034d71-79c5-49c2-82e7-a8c924523cde'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:27.400213 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] The token cache is being invalidate because project fe7ad970f320417ebe46fdbd34fab209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:04:27.400509 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:27.401212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-47034d71-79c5-49c2-82e7-a8c924523cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:04:27.402786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1250/2475] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:04:27 2022] DELETE /identity/v3/projects/fe7ad970f320417ebe46fdbd34fab209 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:04:30.686745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:30.688218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:30.700027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5864796-f685-48da-8fb6-c08d071203a4 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:30.750642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3badb-8003-48d4-bd62-07c531c70225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:30.751271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3badb-8003-48d4-bd62-07c531c70225 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:30.751543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3badb-8003-48d4-bd62-07c531c70225 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:30.751814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3badb-8003-48d4-bd62-07c531c70225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:30.753540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8af3badb-8003-48d4-bd62-07c531c70225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:30.818743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3badb-8003-48d4-bd62-07c531c70225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:30.821198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3badb-8003-48d4-bd62-07c531c70225 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:30.830767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1226/2476] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:04:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:04:32.281978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cbf81-d10c-4caa-8b42-86f370f894a8 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.282516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cbf81-d10c-4caa-8b42-86f370f894a8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.282516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cbf81-d10c-4caa-8b42-86f370f894a8 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.283790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1251/2477] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:04:32.292226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b319d71-100a-4edb-a7f4-883e88c9a0cb None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.292734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b319d71-100a-4edb-a7f4-883e88c9a0cb None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.292849 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b319d71-100a-4edb-a7f4-883e88c9a0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.317312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5b319d71-100a-4edb-a7f4-883e88c9a0cb None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:32.318566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5b319d71-100a-4edb-a7f4-883e88c9a0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:32.397165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1227/2478] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:04:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:32.409254 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cbf81-d10c-4caa-8b42-86f370f894a8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:32.410969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8e2cbf81-d10c-4caa-8b42-86f370f894a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:32.434842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:32.476615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cbf81-d10c-4caa-8b42-86f370f894a8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:32.480266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d18670-6151-4dc3-a747-b80d5cb81996 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:32.480866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d18670-6151-4dc3-a747-b80d5cb81996 service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.481138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d18670-6151-4dc3-a747-b80d5cb81996 service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.481406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d18670-6151-4dc3-a747-b80d5cb81996 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.494255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d18670-6151-4dc3-a747-b80d5cb81996 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:32.495709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d18670-6151-4dc3-a747-b80d5cb81996 service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:32.507382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1252/2479] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:04:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:04:32.582624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c103b7-775b-4603-9f85-318d759ff771 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.583047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c103b7-775b-4603-9f85-318d759ff771 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.583383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c103b7-775b-4603-9f85-318d759ff771 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.584838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1228/2480] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:04:32.591180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54dde-d1bf-471b-bfb3-dbdde5fda881 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.591499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54dde-d1bf-471b-bfb3-dbdde5fda881 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.591723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54dde-d1bf-471b-bfb3-dbdde5fda881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.613356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-15a54dde-d1bf-471b-bfb3-dbdde5fda881 None None] MFA Rules not processed for user `f50dc809ff034866a1f6343e5b32609b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:32.614811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15a54dde-d1bf-471b-bfb3-dbdde5fda881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:32.621603 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1253/2481] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:04:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:32.633908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c103b7-775b-4603-9f85-318d759ff771 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:32.635714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c1c103b7-775b-4603-9f85-318d759ff771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:32.651454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c103b7-775b-4603-9f85-318d759ff771 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:32.654999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec0cc5-9b1d-4f13-af69-eced30cb61f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:32.655689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0cc5-9b1d-4f13-af69-eced30cb61f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.655971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0cc5-9b1d-4f13-af69-eced30cb61f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.656256 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0cc5-9b1d-4f13-af69-eced30cb61f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.665537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0cc5-9b1d-4f13-af69-eced30cb61f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:32.667044 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0cc5-9b1d-4f13-af69-eced30cb61f5 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:32.675823 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1229/2482] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:04:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:04:32.767718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf62e0-8759-4de0-aa3e-a15fc3ac2996 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.768030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf62e0-8759-4de0-aa3e-a15fc3ac2996 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.768304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf62e0-8759-4de0-aa3e-a15fc3ac2996 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.769663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1254/2483] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:04:32.776072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfc60a-b1ca-4238-b1a4-18e711013f4d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.776429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfc60a-b1ca-4238-b1a4-18e711013f4d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.776711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfc60a-b1ca-4238-b1a4-18e711013f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.797428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-00bfc60a-b1ca-4238-b1a4-18e711013f4d None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:32.798562 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-00bfc60a-b1ca-4238-b1a4-18e711013f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:32.808931 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1230/2484] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:04:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:32.819574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf62e0-8759-4de0-aa3e-a15fc3ac2996 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:32.831508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf62e0-8759-4de0-aa3e-a15fc3ac2996 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:32.835696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:32.836289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:32.836563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:32.836855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:32.846993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:32.848402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:32.860591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1255/2485] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:04:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:04:35.885695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925cd08-e76a-4e28-a422-49eddd741357 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:35.886468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925cd08-e76a-4e28-a422-49eddd741357 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:35.886596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925cd08-e76a-4e28-a422-49eddd741357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:35.907461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9925cd08-e76a-4e28-a422-49eddd741357 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:35.908682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9925cd08-e76a-4e28-a422-49eddd741357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:35.914702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:35.966424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1231/2486] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:04:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:35.978628 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:35.980050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:36.048662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411be75-b17b-415d-b11e-63fddade1a61 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:36.054008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd0dae-f26b-4b4a-88ca-455559563740 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:36.054630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0dae-f26b-4b4a-88ca-455559563740 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:36.054934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0dae-f26b-4b4a-88ca-455559563740 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:36.055202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0dae-f26b-4b4a-88ca-455559563740 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:36.063325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd0dae-f26b-4b4a-88ca-455559563740 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:36.064890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd0dae-f26b-4b4a-88ca-455559563740 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:36.073613 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1256/2487] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:04:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:04:45.958984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=20 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:46.069718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=59 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:50.054972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629742b2-4abc-46a3-8298-5cc4ca321401 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:50.055513 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629742b2-4abc-46a3-8298-5cc4ca321401 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:50.055625 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629742b2-4abc-46a3-8298-5cc4ca321401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:50.074737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-629742b2-4abc-46a3-8298-5cc4ca321401 None None] MFA Rules not processed for user `cd5ac67dae69446eb8695af69daa439f`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:50.075964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-629742b2-4abc-46a3-8298-5cc4ca321401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:50.132743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1232/2488] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:04:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:55.374706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf7bc-c210-492c-a7be-7911ab788dc2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:55.375319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf7bc-c210-492c-a7be-7911ab788dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:55.375612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf7bc-c210-492c-a7be-7911ab788dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:55.404114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-21cbf7bc-c210-492c-a7be-7911ab788dc2 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:04:55.405376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-21cbf7bc-c210-492c-a7be-7911ab788dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:04:55.413416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1257/2489] 10.222.0.26 () {58 vars in 967 bytes} [Sat Sep 24 05:04:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:04:55.446792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629742b2-4abc-46a3-8298-5cc4ca321401 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:04:55.457921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629742b2-4abc-46a3-8298-5cc4ca321401 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:04:55.464017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b810d8-687a-4a52-8d9e-ca222485cce9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:04:55.464689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b810d8-687a-4a52-8d9e-ca222485cce9 service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:04:55.464969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b810d8-687a-4a52-8d9e-ca222485cce9 service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:04:55.465242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b810d8-687a-4a52-8d9e-ca222485cce9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:04:55.474515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b810d8-687a-4a52-8d9e-ca222485cce9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:04:55.476971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b810d8-687a-4a52-8d9e-ca222485cce9 service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:04:55.488529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1233/2490] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:04:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:05:05.396464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:05.483142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=31 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:07.154319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432d9a9-c61f-4c0d-a6e8-f79e8e4582a1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:05:07.154851 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432d9a9-c61f-4c0d-a6e8-f79e8e4582a1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:05:07.154946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432d9a9-c61f-4c0d-a6e8-f79e8e4582a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:05:07.174187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e432d9a9-c61f-4c0d-a6e8-f79e8e4582a1 None None] MFA Rules not processed for user `e5cce01c978f43029c17fd696e1a2bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:05:07.175449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e432d9a9-c61f-4c0d-a6e8-f79e8e4582a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:05:07.228741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1258/2491] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:05:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:05:17.221941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=25 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:48.383917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddaf74-3e71-40fa-8c59-721e0171b7fa None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:05:48.384423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddaf74-3e71-40fa-8c59-721e0171b7fa None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:05:48.384527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddaf74-3e71-40fa-8c59-721e0171b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:05:48.404065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-03ddaf74-3e71-40fa-8c59-721e0171b7fa None None] MFA Rules not processed for user `bfeaaa13b150405787bb0a7ca71ada40`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:05:48.405317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-03ddaf74-3e71-40fa-8c59-721e0171b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:05:48.462382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1234/2492] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:05:51.044469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432d9a9-c61f-4c0d-a6e8-f79e8e4582a1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:05:51.046374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e432d9a9-c61f-4c0d-a6e8-f79e8e4582a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:05:51.070003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432d9a9-c61f-4c0d-a6e8-f79e8e4582a1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:05:51.077539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:05:51.078634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:05:51.079484 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:05:51.080000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:05:51.082487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:05:51.104444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:05:51.111541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:05:51.137281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1259/2493] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:05:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:05:52.455202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddaf74-3e71-40fa-8c59-721e0171b7fa None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:05:52.465574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddaf74-3e71-40fa-8c59-721e0171b7fa None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:05:52.470000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:05:52.470721 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:05:52.471014 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:05:52.471305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:05:52.473259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:05:52.491199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:05:52.492288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:05:52.507459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1235/2494] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:05:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:05:58.496777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:05:58.505577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467579ea-2f4e-4143-8d41-cc7e8a49b07b service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:05:58.509945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:05:58.510878 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:05:58.511184 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:05:58.511547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:05:58.513935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:05:58.581849 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:05:58.583679 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:05:58.595095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1260/2495] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:02.335958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:02.337577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:02.354000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5a5cd-a785-4739-b6ed-28be40fad514 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:02.359286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:02.360001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:02.360264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:02.360486 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] PATH_INFO: `/v3/users/cd5ac67dae69446eb8695af69daa439f` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:02.361917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5ac67dae69446eb8695af69daa439f)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:02.363962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:02.420791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5ac67dae69446eb8695af69daa439f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.431387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5ac67dae69446eb8695af69daa439f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.432079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5ac67dae69446eb8695af69daa439f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.433353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5ac67dae69446eb8695af69daa439f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.442193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-1d38fb8a-9188-4b0c-a356-4d86f11e52ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5ac67dae69446eb8695af69daa439f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.475129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1236/2496] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:02 2022] DELETE /identity/v3/users/cd5ac67dae69446eb8695af69daa439f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:02.701013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:02.713643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19426c4-9ff6-457a-8bcd-7a775e372abf service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:02.783877 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:02.784539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:02.784815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:02.785087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] PATH_INFO: `/v3/projects/b3f6f03cfd69410eb7a4dbefca1f95d4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:02.786227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f6f03cfd69410eb7a4dbefca1f95d4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:02.788190 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:02.837251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f6f03cfd69410eb7a4dbefca1f95d4', 'request_id': 'req-f4bba987-7151-4276-8d44-9ea52bdd48ba'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.843020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f6f03cfd69410eb7a4dbefca1f95d4', 'request_id': 'req-f4bba987-7151-4276-8d44-9ea52bdd48ba'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.850146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f6f03cfd69410eb7a4dbefca1f95d4', 'request_id': 'req-f4bba987-7151-4276-8d44-9ea52bdd48ba'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.861902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] The token cache is being invalidate because project b3f6f03cfd69410eb7a4dbefca1f95d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:02.862209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.862947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f4bba987-7151-4276-8d44-9ea52bdd48ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:02.864425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1261/2497] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:02 2022] DELETE /identity/v3/projects/b3f6f03cfd69410eb7a4dbefca1f95d4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:02.869901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7950a7-f43d-4b46-80e8-2e28404ed795 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:02.870922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7950a7-f43d-4b46-80e8-2e28404ed795 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:02.871378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7950a7-f43d-4b46-80e8-2e28404ed795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:02.891945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-8e7950a7-f43d-4b46-80e8-2e28404ed795 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:02.893143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8e7950a7-f43d-4b46-80e8-2e28404ed795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:02.961800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1237/2498] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:02.969603 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12ff2-68b2-44b6-9464-f21d1a948b0f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:02.969890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12ff2-68b2-44b6-9464-f21d1a948b0f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:02.970164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12ff2-68b2-44b6-9464-f21d1a948b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:02.991290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-03e12ff2-68b2-44b6-9464-f21d1a948b0f None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:02.992514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-03e12ff2-68b2-44b6-9464-f21d1a948b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:03.002496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1262/2499] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:03.006548 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7950a7-f43d-4b46-80e8-2e28404ed795 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:03.013744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:03.018264 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7950a7-f43d-4b46-80e8-2e28404ed795 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:03.024686 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:03.025361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:03.025641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:03.025915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:03.026615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:06:03.026971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:03.029039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:03.041055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1238/2500] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:06:03.046951 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12ff2-68b2-44b6-9464-f21d1a948b0f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:03.052708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:03.056864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12ff2-68b2-44b6-9464-f21d1a948b0f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:03.066431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b35705-5239-4353-b0aa-8a71b5cfdb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:03.067399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b35705-5239-4353-b0aa-8a71b5cfdb37 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:03.067674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b35705-5239-4353-b0aa-8a71b5cfdb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:03.067945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b35705-5239-4353-b0aa-8a71b5cfdb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:03.068587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b35705-5239-4353-b0aa-8a71b5cfdb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:03.070494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b35705-5239-4353-b0aa-8a71b5cfdb37 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:03.103136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1263/2501] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:03 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:03.107848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:03.117934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488870-27ff-4747-a4f1-bc84f9ccde24 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:03.178099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0c049-55cb-47e0-88c8-663f960af1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:03.178717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0c049-55cb-47e0-88c8-663f960af1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:03.179081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0c049-55cb-47e0-88c8-663f960af1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:03.179421 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0c049-55cb-47e0-88c8-663f960af1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:03.180137 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0c049-55cb-47e0-88c8-663f960af1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:03.182102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0c049-55cb-47e0-88c8-663f960af1c2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:03.207644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1239/2502] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:03 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:03.212501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b35705-5239-4353-b0aa-8a71b5cfdb37 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:03.223945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b35705-5239-4353-b0aa-8a71b5cfdb37 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:03.228777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c955d9-f8ce-48e3-8f90-b6bd5bcbd076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:03.229752 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c955d9-f8ce-48e3-8f90-b6bd5bcbd076 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:03.230128 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c955d9-f8ce-48e3-8f90-b6bd5bcbd076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:03.231037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c955d9-f8ce-48e3-8f90-b6bd5bcbd076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:03.231984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c955d9-f8ce-48e3-8f90-b6bd5bcbd076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:03.233708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c955d9-f8ce-48e3-8f90-b6bd5bcbd076 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:03.244401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1264/2503] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:03.248745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0c049-55cb-47e0-88c8-663f960af1c2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:03.259592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0c049-55cb-47e0-88c8-663f960af1c2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:03.264970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b53c27-2345-4c7b-82d4-21e5cf618be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:03.265560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b53c27-2345-4c7b-82d4-21e5cf618be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:03.265837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b53c27-2345-4c7b-82d4-21e5cf618be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:03.266103 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b53c27-2345-4c7b-82d4-21e5cf618be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:03.266733 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b53c27-2345-4c7b-82d4-21e5cf618be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:03.268350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b53c27-2345-4c7b-82d4-21e5cf618be7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:03.279557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1240/2504] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:03.284157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c955d9-f8ce-48e3-8f90-b6bd5bcbd076 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:03.295587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c955d9-f8ce-48e3-8f90-b6bd5bcbd076 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:03.300396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:03.301496 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:03.302024 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:03.302379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] PATH_INFO: `/v3/projects/b4ff59c32775435db52c575879ed904b/users/32f8ae4c47b84446b52ce3e0672596dd/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:03.318841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ff59c32775435db52c575879ed904b, user_id=32f8ae4c47b84446b52ce3e0672596dd, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:03.321640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:03.335383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1265/2505] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:03 2022] PUT /identity/v3/projects/b4ff59c32775435db52c575879ed904b/users/32f8ae4c47b84446b52ce3e0672596dd/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:03.348215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49feddd-af7c-4395-89e6-5ef367b90def None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:03.348778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49feddd-af7c-4395-89e6-5ef367b90def None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:03.348904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49feddd-af7c-4395-89e6-5ef367b90def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:03.380942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a49feddd-af7c-4395-89e6-5ef367b90def None None] MFA Rules not processed for user `32f8ae4c47b84446b52ce3e0672596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:03.382159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a49feddd-af7c-4395-89e6-5ef367b90def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:03.461508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1241/2506] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:03.469245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:03.471979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:03.557677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62454f5a-6480-4ce6-a24f-585164f0c9ea admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:03.563801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b46b-8b28-476a-b60b-9cc794e6d9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:03.564443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b46b-8b28-476a-b60b-9cc794e6d9ee service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:03.564749 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b46b-8b28-476a-b60b-9cc794e6d9ee service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:03.565089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b46b-8b28-476a-b60b-9cc794e6d9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:03.573114 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3b46b-8b28-476a-b60b-9cc794e6d9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:03.575449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3b46b-8b28-476a-b60b-9cc794e6d9ee service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:03.584967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1266/2507] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:06.946371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49feddd-af7c-4395-89e6-5ef367b90def None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:06.947831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a49feddd-af7c-4395-89e6-5ef367b90def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:07.004453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49feddd-af7c-4395-89e6-5ef367b90def None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:07.008038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd2cef-0e62-4009-85f7-98a2ed6bea79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:07.008640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2cef-0e62-4009-85f7-98a2ed6bea79 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:07.008915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2cef-0e62-4009-85f7-98a2ed6bea79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:07.009182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2cef-0e62-4009-85f7-98a2ed6bea79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:07.011752 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ddcd2cef-0e62-4009-85f7-98a2ed6bea79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:07.024232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:07.071198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2cef-0e62-4009-85f7-98a2ed6bea79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:07.072623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2cef-0e62-4009-85f7-98a2ed6bea79 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:07.081688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1242/2508] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:08.854782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b46b-8b28-476a-b60b-9cc794e6d9ee service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:08.924020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b46b-8b28-476a-b60b-9cc794e6d9ee service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:08.928744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:08.929364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:08.929638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:08.929911 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] PATH_INFO: `/v3/users/32f8ae4c47b84446b52ce3e0672596dd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:08.931060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f8ae4c47b84446b52ce3e0672596dd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:08.933724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:08.977470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:08.989767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f8ae4c47b84446b52ce3e0672596dd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:08.998042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f8ae4c47b84446b52ce3e0672596dd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:08.998653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f8ae4c47b84446b52ce3e0672596dd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:08.999264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f8ae4c47b84446b52ce3e0672596dd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:09.006345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f8ae4c47b84446b52ce3e0672596dd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:09.024821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1267/2509] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:08 2022] DELETE /identity/v3/users/32f8ae4c47b84446b52ce3e0672596dd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:09.029922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05c0c7-f24f-4fc3-a7ad-8c30e0d9255d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.030441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05c0c7-f24f-4fc3-a7ad-8c30e0d9255d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.030535 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05c0c7-f24f-4fc3-a7ad-8c30e0d9255d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.050137 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5e05c0c7-f24f-4fc3-a7ad-8c30e0d9255d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:09.052126 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5e05c0c7-f24f-4fc3-a7ad-8c30e0d9255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:09.114665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1243/2510] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:09.125300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:09.126734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:09.188000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc81a34-f46a-4e80-bf13-4fad560426e7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:09.191990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae7dcb-10ae-423a-ad89-4bbb2c76e6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:09.192607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7dcb-10ae-423a-ad89-4bbb2c76e6ff service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.192860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7dcb-10ae-423a-ad89-4bbb2c76e6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.193147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7dcb-10ae-423a-ad89-4bbb2c76e6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.203544 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae7dcb-10ae-423a-ad89-4bbb2c76e6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:09.204977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae7dcb-10ae-423a-ad89-4bbb2c76e6ff service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:09.214351 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1268/2511] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:09.486706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05c0c7-f24f-4fc3-a7ad-8c30e0d9255d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:09.488210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5e05c0c7-f24f-4fc3-a7ad-8c30e0d9255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:09.503160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05c0c7-f24f-4fc3-a7ad-8c30e0d9255d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:09.507852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:09.508624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.508896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.509163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] PATH_INFO: `/v3/projects/b4ff59c32775435db52c575879ed904b` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.510299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ff59c32775435db52c575879ed904b)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:09.512750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:09.560149 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ff59c32775435db52c575879ed904b', 'request_id': 'req-2e9c287f-8b39-4ee7-9028-b51be94eb281'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:09.565565 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ff59c32775435db52c575879ed904b', 'request_id': 'req-2e9c287f-8b39-4ee7-9028-b51be94eb281'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:09.573109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ff59c32775435db52c575879ed904b', 'request_id': 'req-2e9c287f-8b39-4ee7-9028-b51be94eb281'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:09.584297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] The token cache is being invalidate because project b4ff59c32775435db52c575879ed904b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:09.584582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:09.585198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-2e9c287f-8b39-4ee7-9028-b51be94eb281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:09.586655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1244/2512] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:09 2022] DELETE /identity/v3/projects/b4ff59c32775435db52c575879ed904b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:09.591698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed19eb-cf80-4c62-89b5-dbbf8f9dbc30 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.591982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed19eb-cf80-4c62-89b5-dbbf8f9dbc30 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.592250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed19eb-cf80-4c62-89b5-dbbf8f9dbc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.612322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-59ed19eb-cf80-4c62-89b5-dbbf8f9dbc30 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:09.613533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-59ed19eb-cf80-4c62-89b5-dbbf8f9dbc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:09.680953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1269/2513] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:09.689709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcf646-d96a-43d8-b04a-c2c66fd8392b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.689995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcf646-d96a-43d8-b04a-c2c66fd8392b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.690270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcf646-d96a-43d8-b04a-c2c66fd8392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.709964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f7dcf646-d96a-43d8-b04a-c2c66fd8392b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:09.711207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f7dcf646-d96a-43d8-b04a-c2c66fd8392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:09.719136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1245/2514] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:06:09.723359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed19eb-cf80-4c62-89b5-dbbf8f9dbc30 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:09.733785 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed19eb-cf80-4c62-89b5-dbbf8f9dbc30 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:09.738237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:09.738856 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.739130 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.739426 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.740058 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:06:09.740355 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:09.741915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:09.754167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1270/2515] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:06:09.758732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcf646-d96a-43d8-b04a-c2c66fd8392b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:09.769202 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcf646-d96a-43d8-b04a-c2c66fd8392b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:09.774000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea6606-b5ff-42bc-9f72-331ee57abfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:09.774577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea6606-b5ff-42bc-9f72-331ee57abfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.774880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea6606-b5ff-42bc-9f72-331ee57abfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.775147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea6606-b5ff-42bc-9f72-331ee57abfd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.775774 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea6606-b5ff-42bc-9f72-331ee57abfd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:09.778404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea6606-b5ff-42bc-9f72-331ee57abfd9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:09.804871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1246/2516] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:09 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:09.809212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:09.819013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d60b3c-1b69-44dd-a81a-645e4540258e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:09.858358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:09.875429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb556f-c62f-49ab-b231-adad12973a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:09.876022 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb556f-c62f-49ab-b231-adad12973a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.876295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb556f-c62f-49ab-b231-adad12973a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.876558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb556f-c62f-49ab-b231-adad12973a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.877173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb556f-c62f-49ab-b231-adad12973a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:09.879076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb556f-c62f-49ab-b231-adad12973a75 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:09.902721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1271/2517] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:09 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:09.905947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea6606-b5ff-42bc-9f72-331ee57abfd9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:09.916279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea6606-b5ff-42bc-9f72-331ee57abfd9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:09.921142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec7e03-19b4-4b54-8e0a-c49fe37d4423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:09.921751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec7e03-19b4-4b54-8e0a-c49fe37d4423 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.922020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec7e03-19b4-4b54-8e0a-c49fe37d4423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.922286 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec7e03-19b4-4b54-8e0a-c49fe37d4423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.922949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec7e03-19b4-4b54-8e0a-c49fe37d4423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:09.924542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec7e03-19b4-4b54-8e0a-c49fe37d4423 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:09.926556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:09.936533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1247/2518] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:06:09.940494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb556f-c62f-49ab-b231-adad12973a75 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:09.950982 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb556f-c62f-49ab-b231-adad12973a75 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:09.955550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6aa77-12af-48eb-bf06-f209d32a55ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:09.956144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6aa77-12af-48eb-bf06-f209d32a55ba admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.956421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6aa77-12af-48eb-bf06-f209d32a55ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.956692 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6aa77-12af-48eb-bf06-f209d32a55ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:09.957323 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6aa77-12af-48eb-bf06-f209d32a55ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:09.958927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6aa77-12af-48eb-bf06-f209d32a55ba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:09.969680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1272/2519] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:09.973464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec7e03-19b4-4b54-8e0a-c49fe37d4423 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:09.984157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec7e03-19b4-4b54-8e0a-c49fe37d4423 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:09.988815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:09.989459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:09.989734 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:09.990004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] PATH_INFO: `/v3/projects/81ddcaefd9d1424da4d0f3d50e018227/users/ec214cf9d2ac41e9bde54ac0ebfff308/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:10.005254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ddcaefd9d1424da4d0f3d50e018227, user_id=ec214cf9d2ac41e9bde54ac0ebfff308, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:10.007945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:10.026675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1248/2520] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:09 2022] PUT /identity/v3/projects/81ddcaefd9d1424da4d0f3d50e018227/users/ec214cf9d2ac41e9bde54ac0ebfff308/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:10.036788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65774dd5-d13a-461c-9791-c2e273d81300 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:10.037074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65774dd5-d13a-461c-9791-c2e273d81300 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:10.037347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65774dd5-d13a-461c-9791-c2e273d81300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:10.066003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-65774dd5-d13a-461c-9791-c2e273d81300 None None] MFA Rules not processed for user `ec214cf9d2ac41e9bde54ac0ebfff308`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:10.067235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-65774dd5-d13a-461c-9791-c2e273d81300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:10.129571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1273/2521] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:10.141057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:10.142926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:10.200148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2a437-ca43-484c-b45f-24af187f7ade admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:10.203912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db367988-1fba-4ebb-b4a1-6dbfabc87d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:10.204512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db367988-1fba-4ebb-b4a1-6dbfabc87d8a service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:10.204907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db367988-1fba-4ebb-b4a1-6dbfabc87d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:10.205190 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db367988-1fba-4ebb-b4a1-6dbfabc87d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:10.213458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db367988-1fba-4ebb-b4a1-6dbfabc87d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:10.214982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db367988-1fba-4ebb-b4a1-6dbfabc87d8a service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:10.223942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1249/2522] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:16.325394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65774dd5-d13a-461c-9791-c2e273d81300 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:16.326860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-65774dd5-d13a-461c-9791-c2e273d81300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:16.386990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65774dd5-d13a-461c-9791-c2e273d81300 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:16.390965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f314b98-68ed-46da-bab1-89414fa77a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:16.391564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314b98-68ed-46da-bab1-89414fa77a4e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:16.391839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314b98-68ed-46da-bab1-89414fa77a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:16.392108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314b98-68ed-46da-bab1-89414fa77a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:16.393828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5f314b98-68ed-46da-bab1-89414fa77a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:16.403192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f314b98-68ed-46da-bab1-89414fa77a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:16.404709 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f314b98-68ed-46da-bab1-89414fa77a4e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:16.412625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1274/2523] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:18.775339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db367988-1fba-4ebb-b4a1-6dbfabc87d8a service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:18.849367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db367988-1fba-4ebb-b4a1-6dbfabc87d8a service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:18.853838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:18.854464 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:18.854743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:18.855118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] PATH_INFO: `/v3/users/ec214cf9d2ac41e9bde54ac0ebfff308` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:18.857186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec214cf9d2ac41e9bde54ac0ebfff308)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:18.859169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:18.911844 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec214cf9d2ac41e9bde54ac0ebfff308'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:18.919247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec214cf9d2ac41e9bde54ac0ebfff308'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:18.919898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec214cf9d2ac41e9bde54ac0ebfff308'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:18.920527 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec214cf9d2ac41e9bde54ac0ebfff308'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:18.928197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec214cf9d2ac41e9bde54ac0ebfff308'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:18.939870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:18.947010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1250/2524] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:18 2022] DELETE /identity/v3/users/ec214cf9d2ac41e9bde54ac0ebfff308 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:18.952035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85338a2-286f-4a49-99b2-67661de2fea3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:18.952532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85338a2-286f-4a49-99b2-67661de2fea3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:18.952764 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85338a2-286f-4a49-99b2-67661de2fea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:18.972858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a85338a2-286f-4a49-99b2-67661de2fea3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:18.974354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a85338a2-286f-4a49-99b2-67661de2fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:19.027789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:19.041661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1275/2525] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:06:19.051166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:19.052631 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:19.113617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b845d-bbca-4079-ae74-36d7b4e16452 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:19.117297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d985b-bd71-45cf-8daa-8bc545d8f7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:19.117886 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d985b-bd71-45cf-8daa-8bc545d8f7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.118158 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d985b-bd71-45cf-8daa-8bc545d8f7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.118424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d985b-bd71-45cf-8daa-8bc545d8f7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.127890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d985b-bd71-45cf-8daa-8bc545d8f7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:19.129397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d985b-bd71-45cf-8daa-8bc545d8f7a4 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:19.139512 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1251/2526] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:19.418079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85338a2-286f-4a49-99b2-67661de2fea3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:19.418079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a85338a2-286f-4a49-99b2-67661de2fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:19.432946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85338a2-286f-4a49-99b2-67661de2fea3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:19.439068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:19.439844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.440259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.440670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] PATH_INFO: `/v3/projects/81ddcaefd9d1424da4d0f3d50e018227` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.441993 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ddcaefd9d1424da4d0f3d50e018227)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:19.444170 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:19.495344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ddcaefd9d1424da4d0f3d50e018227', 'request_id': 'req-48369289-c870-4b44-a753-8702b0adf0ce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:19.501574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ddcaefd9d1424da4d0f3d50e018227', 'request_id': 'req-48369289-c870-4b44-a753-8702b0adf0ce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:19.509407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ddcaefd9d1424da4d0f3d50e018227', 'request_id': 'req-48369289-c870-4b44-a753-8702b0adf0ce'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:19.522266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] The token cache is being invalidate because project 81ddcaefd9d1424da4d0f3d50e018227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:19.522543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:19.523192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-48369289-c870-4b44-a753-8702b0adf0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:19.524745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1276/2527] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:19 2022] DELETE /identity/v3/projects/81ddcaefd9d1424da4d0f3d50e018227 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:19.531506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb20c70-3156-401a-99e1-bc6034bb3810 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.531785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb20c70-3156-401a-99e1-bc6034bb3810 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.532052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb20c70-3156-401a-99e1-bc6034bb3810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.551272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7bb20c70-3156-401a-99e1-bc6034bb3810 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:19.552474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7bb20c70-3156-401a-99e1-bc6034bb3810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:19.624182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1252/2528] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:19.633397 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958cfca-87be-45fb-8627-8f8513062d15 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.633583 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958cfca-87be-45fb-8627-8f8513062d15 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.633866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958cfca-87be-45fb-8627-8f8513062d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.662604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2958cfca-87be-45fb-8627-8f8513062d15 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:19.663874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2958cfca-87be-45fb-8627-8f8513062d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:19.672307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1277/2529] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:19.676155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb20c70-3156-401a-99e1-bc6034bb3810 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:19.686744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb20c70-3156-401a-99e1-bc6034bb3810 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:19.691349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:19.691951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.692228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.692499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.693139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:06:19.693445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:19.695095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:19.708087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1253/2530] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:06:19.712462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958cfca-87be-45fb-8627-8f8513062d15 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:19.722309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958cfca-87be-45fb-8627-8f8513062d15 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:19.726917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2896-2ddf-4a5a-b1d7-c571a107a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:19.727510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2896-2ddf-4a5a-b1d7-c571a107a552 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.727892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2896-2ddf-4a5a-b1d7-c571a107a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.728189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2896-2ddf-4a5a-b1d7-c571a107a552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.728885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe2896-2ddf-4a5a-b1d7-c571a107a552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:19.730818 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe2896-2ddf-4a5a-b1d7-c571a107a552 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:19.758991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1278/2531] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:19 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:19.764399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:19.774415 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705b69-72a6-44f8-a477-fc4e1249a255 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:19.843808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94287a03-d35a-4379-bd2a-4cf56be2f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:19.844543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94287a03-d35a-4379-bd2a-4cf56be2f795 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.844687 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94287a03-d35a-4379-bd2a-4cf56be2f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.844959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94287a03-d35a-4379-bd2a-4cf56be2f795 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.845600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94287a03-d35a-4379-bd2a-4cf56be2f795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:19.847570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94287a03-d35a-4379-bd2a-4cf56be2f795 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:19.878119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2896-2ddf-4a5a-b1d7-c571a107a552 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:19.880146 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1254/2532] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:19 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:19.891922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2896-2ddf-4a5a-b1d7-c571a107a552 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:19.897637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf57b6-64b2-4278-9286-7f3595fd8922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:19.898869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf57b6-64b2-4278-9286-7f3595fd8922 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.899155 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf57b6-64b2-4278-9286-7f3595fd8922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.899450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf57b6-64b2-4278-9286-7f3595fd8922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.900161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf57b6-64b2-4278-9286-7f3595fd8922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:19.901891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf57b6-64b2-4278-9286-7f3595fd8922 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:19.916969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1279/2533] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:06:19.918241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94287a03-d35a-4379-bd2a-4cf56be2f795 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:19.929797 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94287a03-d35a-4379-bd2a-4cf56be2f795 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:19.934939 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01dd3e-6738-4614-82b4-6341b4ab7d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:19.935615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dd3e-6738-4614-82b4-6341b4ab7d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.935898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dd3e-6738-4614-82b4-6341b4ab7d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.936169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dd3e-6738-4614-82b4-6341b4ab7d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.936811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01dd3e-6738-4614-82b4-6341b4ab7d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:19.938405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01dd3e-6738-4614-82b4-6341b4ab7d73 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:19.954334 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1255/2534] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:19.958503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf57b6-64b2-4278-9286-7f3595fd8922 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:19.969849 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf57b6-64b2-4278-9286-7f3595fd8922 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:19.974652 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5bc9-0d1f-48e0-ab2b-8780b6511cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:19.975343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5bc9-0d1f-48e0-ab2b-8780b6511cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:19.975625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5bc9-0d1f-48e0-ab2b-8780b6511cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:19.975900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5bc9-0d1f-48e0-ab2b-8780b6511cea admin admin] PATH_INFO: `/v3/projects/57aeb0820fdf4b44a2186463d89c38cd/users/c04e5d77af6140c089ae5d8869a0a31e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:19.992503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5bc9-0d1f-48e0-ab2b-8780b6511cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aeb0820fdf4b44a2186463d89c38cd, user_id=c04e5d77af6140c089ae5d8869a0a31e, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:19.996693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5bc9-0d1f-48e0-ab2b-8780b6511cea admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:20.011171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1280/2535] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:19 2022] PUT /identity/v3/projects/57aeb0820fdf4b44a2186463d89c38cd/users/c04e5d77af6140c089ae5d8869a0a31e/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:20.022387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5e109-105c-4813-9677-bcdc70be5016 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.022670 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5e109-105c-4813-9677-bcdc70be5016 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.022976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5e109-105c-4813-9677-bcdc70be5016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.032472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:20.054664 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-88a5e109-105c-4813-9677-bcdc70be5016 None None] MFA Rules not processed for user `c04e5d77af6140c089ae5d8869a0a31e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:20.055907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-88a5e109-105c-4813-9677-bcdc70be5016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:20.128247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1256/2536] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:20.132835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5bc9-0d1f-48e0-ab2b-8780b6511cea admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:20.199069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5bc9-0d1f-48e0-ab2b-8780b6511cea admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:20.204697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b526c-1615-45eb-9bb0-8acfc801d359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:20.205296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b526c-1615-45eb-9bb0-8acfc801d359 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.205590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b526c-1615-45eb-9bb0-8acfc801d359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.205861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b526c-1615-45eb-9bb0-8acfc801d359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.206497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b526c-1615-45eb-9bb0-8acfc801d359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:20.208432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b526c-1615-45eb-9bb0-8acfc801d359 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:20.230219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:20.239180 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1281/2537] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:20 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:20.243148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5e109-105c-4813-9677-bcdc70be5016 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:20.256113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5e109-105c-4813-9677-bcdc70be5016 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:20.316280 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f4468-0978-4236-b8bc-e2d7410fe44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:20.316807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f4468-0978-4236-b8bc-e2d7410fe44e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.317082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f4468-0978-4236-b8bc-e2d7410fe44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.317350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f4468-0978-4236-b8bc-e2d7410fe44e admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.318162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f4468-0978-4236-b8bc-e2d7410fe44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:20.320083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f4468-0978-4236-b8bc-e2d7410fe44e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:20.344875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1257/2538] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:20 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:20.348950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b526c-1615-45eb-9bb0-8acfc801d359 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:20.359745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b526c-1615-45eb-9bb0-8acfc801d359 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:20.365098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a218ce5-87cc-4ea9-a174-16aa22521daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:20.365697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218ce5-87cc-4ea9-a174-16aa22521daa admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.366019 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218ce5-87cc-4ea9-a174-16aa22521daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.366412 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218ce5-87cc-4ea9-a174-16aa22521daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.367116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a218ce5-87cc-4ea9-a174-16aa22521daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:20.368816 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a218ce5-87cc-4ea9-a174-16aa22521daa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:20.380500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1282/2539] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:20.384813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f4468-0978-4236-b8bc-e2d7410fe44e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:20.396283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f4468-0978-4236-b8bc-e2d7410fe44e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:20.400983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695273-d40c-4961-b378-de42aea17a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:20.401598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695273-d40c-4961-b378-de42aea17a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.401876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695273-d40c-4961-b378-de42aea17a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.402143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695273-d40c-4961-b378-de42aea17a53 admin admin] PATH_INFO: `/v3/projects/17b47ac209d846599f04d6118b3c790e/users/ea77f70958554974ac5bb4788f526bd6/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.418821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3695273-d40c-4961-b378-de42aea17a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b47ac209d846599f04d6118b3c790e, user_id=ea77f70958554974ac5bb4788f526bd6, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:20.421538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3695273-d40c-4961-b378-de42aea17a53 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:20.437870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1258/2540] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:20 2022] PUT /identity/v3/projects/17b47ac209d846599f04d6118b3c790e/users/ea77f70958554974ac5bb4788f526bd6/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:20.443847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a218ce5-87cc-4ea9-a174-16aa22521daa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:20.454285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a218ce5-87cc-4ea9-a174-16aa22521daa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:20.508589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5a012-97fb-45fb-b8e0-8840f725e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:20.509188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5a012-97fb-45fb-b8e0-8840f725e0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.509466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5a012-97fb-45fb-b8e0-8840f725e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.509736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5a012-97fb-45fb-b8e0-8840f725e0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.510369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5a012-97fb-45fb-b8e0-8840f725e0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:20.511983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5a012-97fb-45fb-b8e0-8840f725e0b9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:20.522546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1283/2541] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:20.526802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695273-d40c-4961-b378-de42aea17a53 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:20.537194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695273-d40c-4961-b378-de42aea17a53 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:20.541807 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:20.542469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.542745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.543046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] PATH_INFO: `/v3/projects/17b47ac209d846599f04d6118b3c790e/users/ea77f70958554974ac5bb4788f526bd6/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.545260 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b47ac209d846599f04d6118b3c790e, user_id=ea77f70958554974ac5bb4788f526bd6, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:20.547965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:20.558675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1259/2542] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:20 2022] PUT /identity/v3/projects/17b47ac209d846599f04d6118b3c790e/users/ea77f70958554974ac5bb4788f526bd6/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:20.569695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e224d9-d247-4bf5-a725-7b89da6338cf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.569907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e224d9-d247-4bf5-a725-7b89da6338cf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.570176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e224d9-d247-4bf5-a725-7b89da6338cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.600103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a2e224d9-d247-4bf5-a725-7b89da6338cf None None] MFA Rules not processed for user `ea77f70958554974ac5bb4788f526bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:20.601319 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a2e224d9-d247-4bf5-a725-7b89da6338cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:20.670703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1284/2543] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:20.681534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:20.683302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:20.737800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:20.745267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c22f-3837-48ba-9021-022f4861340e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:20.749740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a197-89ee-4246-b207-fe0d884b9aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:20.750454 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a197-89ee-4246-b207-fe0d884b9aaf service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:20.750736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a197-89ee-4246-b207-fe0d884b9aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:20.751047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a197-89ee-4246-b207-fe0d884b9aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:20.760508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8a197-89ee-4246-b207-fe0d884b9aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:20.761935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8a197-89ee-4246-b207-fe0d884b9aaf service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:20.772204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1260/2544] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:22.269693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e7904-d143-4e13-a160-4a55f006942b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:22.270163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e7904-d143-4e13-a160-4a55f006942b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:22.270459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e7904-d143-4e13-a160-4a55f006942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:22.281975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a197-89ee-4246-b207-fe0d884b9aaf service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:22.294018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-026e7904-d143-4e13-a160-4a55f006942b None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:22.295757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-026e7904-d143-4e13-a160-4a55f006942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:22.361260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1285/2545] 10.222.0.26 () {58 vars in 967 bytes} [Sat Sep 24 05:06:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:22.364085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a197-89ee-4246-b207-fe0d884b9aaf service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:22.373921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:22.374561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:22.374929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:22.375192 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] PATH_INFO: `/v3/users/c04e5d77af6140c089ae5d8869a0a31e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:22.376497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04e5d77af6140c089ae5d8869a0a31e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:22.378403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:22.435063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e7904-d143-4e13-a160-4a55f006942b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:22.436820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-026e7904-d143-4e13-a160-4a55f006942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:22.454975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04e5d77af6140c089ae5d8869a0a31e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:22.464219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04e5d77af6140c089ae5d8869a0a31e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:22.464968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04e5d77af6140c089ae5d8869a0a31e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:22.466360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04e5d77af6140c089ae5d8869a0a31e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:22.468721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:22.475182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-a7f11b58-d4bc-4b88-8d70-4222282c2e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04e5d77af6140c089ae5d8869a0a31e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:22.500207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1261/2546] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:22 2022] DELETE /identity/v3/users/c04e5d77af6140c089ae5d8869a0a31e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:22.504521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e557d-31ed-44b2-a350-e92a033e2eac None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:22.504809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e557d-31ed-44b2-a350-e92a033e2eac None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:22.505080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e557d-31ed-44b2-a350-e92a033e2eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:22.524758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4c8e557d-31ed-44b2-a350-e92a033e2eac None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:22.525962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4c8e557d-31ed-44b2-a350-e92a033e2eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:22.538639 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e7904-d143-4e13-a160-4a55f006942b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:22.596400 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1262/2547] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:06:22.612109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e557d-31ed-44b2-a350-e92a033e2eac None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:22.613437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4c8e557d-31ed-44b2-a350-e92a033e2eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:22.616483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:22.617111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:22.617433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:22.617703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:22.619466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:22.625673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:22.682593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e557d-31ed-44b2-a350-e92a033e2eac None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:22.683527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:22.686146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:22.687035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2b0c-9eb7-4c9b-b426-207a6f0750e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:22.687690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2b0c-9eb7-4c9b-b426-207a6f0750e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:22.688048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2b0c-9eb7-4c9b-b426-207a6f0750e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:22.688322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2b0c-9eb7-4c9b-b426-207a6f0750e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:22.695448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1286/2548] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:06:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:06:22.699195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed2b0c-9eb7-4c9b-b426-207a6f0750e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:22.701831 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed2b0c-9eb7-4c9b-b426-207a6f0750e5 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:22.712753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1263/2549] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:23.005795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:23.007352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:23.032555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f3456-7bda-47ff-88b7-66c484712ac2 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:23.037346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:23.037978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:23.038257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:23.038531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] PATH_INFO: `/v3/projects/57aeb0820fdf4b44a2186463d89c38cd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:23.040402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=57aeb0820fdf4b44a2186463d89c38cd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:23.042306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:23.093056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aeb0820fdf4b44a2186463d89c38cd', 'request_id': 'req-e859e334-5877-440c-a658-0b62b9ded7ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.095364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:23.100660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aeb0820fdf4b44a2186463d89c38cd', 'request_id': 'req-e859e334-5877-440c-a658-0b62b9ded7ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.108065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aeb0820fdf4b44a2186463d89c38cd', 'request_id': 'req-e859e334-5877-440c-a658-0b62b9ded7ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.119734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] The token cache is being invalidate because project 57aeb0820fdf4b44a2186463d89c38cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:23.119932 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.120566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.122394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1287/2550] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:23 2022] DELETE /identity/v3/projects/57aeb0820fdf4b44a2186463d89c38cd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:23.126296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2b0c-9eb7-4c9b-b426-207a6f0750e5 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:23.141480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2b0c-9eb7-4c9b-b426-207a6f0750e5 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:23.199777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:23.201096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:23.201359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:23.201709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] PATH_INFO: `/v3/users/ea77f70958554974ac5bb4788f526bd6` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:23.202932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea77f70958554974ac5bb4788f526bd6)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:23.205092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:23.255208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea77f70958554974ac5bb4788f526bd6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.264470 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea77f70958554974ac5bb4788f526bd6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.265087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea77f70958554974ac5bb4788f526bd6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.265696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea77f70958554974ac5bb4788f526bd6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.272983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea77f70958554974ac5bb4788f526bd6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.291276 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1264/2551] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:23 2022] DELETE /identity/v3/users/ea77f70958554974ac5bb4788f526bd6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:23.563731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:23.565723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:23.581089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e334-5877-440c-a658-0b62b9ded7ea admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:23.649171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:23.650468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:23.650834 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:23.651171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] PATH_INFO: `/v3/projects/17b47ac209d846599f04d6118b3c790e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:23.652504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b47ac209d846599f04d6118b3c790e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:23.656712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:23.724827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b47ac209d846599f04d6118b3c790e', 'request_id': 'req-65f9cd7b-f356-4300-81ca-78d395c25107'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.730165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:23.732806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:23.733065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b47ac209d846599f04d6118b3c790e', 'request_id': 'req-65f9cd7b-f356-4300-81ca-78d395c25107'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.744318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b47ac209d846599f04d6118b3c790e', 'request_id': 'req-65f9cd7b-f356-4300-81ca-78d395c25107'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.757505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] The token cache is being invalidate because project 17b47ac209d846599f04d6118b3c790e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:23.757791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.758738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65f9cd7b-f356-4300-81ca-78d395c25107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:23.760388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1288/2552] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:23 2022] DELETE /identity/v3/projects/17b47ac209d846599f04d6118b3c790e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:23.766233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c54c03-4571-4ac2-a800-de112819ae49 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:23.766598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c54c03-4571-4ac2-a800-de112819ae49 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:23.766986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c54c03-4571-4ac2-a800-de112819ae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:23.777491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:23.790808 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-43c54c03-4571-4ac2-a800-de112819ae49 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:23.792151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-43c54c03-4571-4ac2-a800-de112819ae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:23.807241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05378fd9-1aac-4c0b-893a-7345bb3a8ba1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:23.874811 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1289/2553] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:23.880906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:23.881522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:23.881773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ca2c-7a79-4551-9d42-74e668daa46b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:23.881899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:23.882083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:23.882236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ca2c-7a79-4551-9d42-74e668daa46b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:23.882575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ca2c-7a79-4551-9d42-74e668daa46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:23.883893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:23.897425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:23.898835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:23.906995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ff64ca2c-7a79-4551-9d42-74e668daa46b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:23.909119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff64ca2c-7a79-4551-9d42-74e668daa46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:23.910489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1265/2554] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:06:23.917327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1290/2555] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:06:23.921680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:23.937967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f945c1-0946-45c5-85ef-60c7aad05239 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:23.942997 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:23.943700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:23.944164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:23.944640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:23.945384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:06:23.945926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:23.947647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:23.967717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1266/2556] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:06:23.969366 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ca2c-7a79-4551-9d42-74e668daa46b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:23.983046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:23.986270 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ca2c-7a79-4551-9d42-74e668daa46b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:23.993931 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19ac1-586c-423b-b55d-ada788b87009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:23.994667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19ac1-586c-423b-b55d-ada788b87009 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:23.995032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19ac1-586c-423b-b55d-ada788b87009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:23.995506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19ac1-586c-423b-b55d-ada788b87009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:23.996370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a19ac1-586c-423b-b55d-ada788b87009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:23.999941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a19ac1-586c-423b-b55d-ada788b87009 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.038532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1291/2557] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:23 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:24.044671 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.058135 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556289c-1eea-4930-bc01-03e3b44357af admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.180718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78b57-8642-40a3-b4bf-1ace38c0ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.181592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78b57-8642-40a3-b4bf-1ace38c0ad3e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.182057 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78b57-8642-40a3-b4bf-1ace38c0ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.182326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78b57-8642-40a3-b4bf-1ace38c0ad3e admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.183000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c78b57-8642-40a3-b4bf-1ace38c0ad3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.185767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c78b57-8642-40a3-b4bf-1ace38c0ad3e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.219124 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1267/2558] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:24 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:24.219908 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19ac1-586c-423b-b55d-ada788b87009 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.232102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19ac1-586c-423b-b55d-ada788b87009 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.236704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058f2a5-2854-4252-a857-f69725bdada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.237451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f2a5-2854-4252-a857-f69725bdada3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.237731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f2a5-2854-4252-a857-f69725bdada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.238132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f2a5-2854-4252-a857-f69725bdada3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.238810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058f2a5-2854-4252-a857-f69725bdada3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.240402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058f2a5-2854-4252-a857-f69725bdada3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.254154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1292/2559] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:06:24.256063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78b57-8642-40a3-b4bf-1ace38c0ad3e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.267338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78b57-8642-40a3-b4bf-1ace38c0ad3e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.272999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df607c95-109f-485b-b518-46ee7c15cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.273960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df607c95-109f-485b-b518-46ee7c15cf51 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.274218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df607c95-109f-485b-b518-46ee7c15cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.274630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df607c95-109f-485b-b518-46ee7c15cf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.275398 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df607c95-109f-485b-b518-46ee7c15cf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.277157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df607c95-109f-485b-b518-46ee7c15cf51 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.290026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1268/2560] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:24.296177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058f2a5-2854-4252-a857-f69725bdada3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.306645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058f2a5-2854-4252-a857-f69725bdada3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.312012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171fa1d-39d8-4958-b3ef-4aa55c9071cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.312670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171fa1d-39d8-4958-b3ef-4aa55c9071cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.312946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171fa1d-39d8-4958-b3ef-4aa55c9071cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.313907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171fa1d-39d8-4958-b3ef-4aa55c9071cd admin admin] PATH_INFO: `/v3/projects/f4ebd0b9119d4063b3bdc337b3122c5d/users/ab019f93a9764b92a017d4359670d3a9/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.329686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171fa1d-39d8-4958-b3ef-4aa55c9071cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ebd0b9119d4063b3bdc337b3122c5d, user_id=ab019f93a9764b92a017d4359670d3a9, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.332175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171fa1d-39d8-4958-b3ef-4aa55c9071cd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.353638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1293/2561] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:24 2022] PUT /identity/v3/projects/f4ebd0b9119d4063b3bdc337b3122c5d/users/ab019f93a9764b92a017d4359670d3a9/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:24.365310 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209e9a1-efd9-4f1d-9a12-bcdd9e4719b6 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.365833 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209e9a1-efd9-4f1d-9a12-bcdd9e4719b6 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.366077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209e9a1-efd9-4f1d-9a12-bcdd9e4719b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.396873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7209e9a1-efd9-4f1d-9a12-bcdd9e4719b6 None None] MFA Rules not processed for user `ab019f93a9764b92a017d4359670d3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:24.398226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7209e9a1-efd9-4f1d-9a12-bcdd9e4719b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:24.462059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:24.489428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1269/2562] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:06:24.494121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171fa1d-39d8-4958-b3ef-4aa55c9071cd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.575976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171fa1d-39d8-4958-b3ef-4aa55c9071cd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.581086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c01d66-04d2-475b-8f1d-1d5fcdb65cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.581887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c01d66-04d2-475b-8f1d-1d5fcdb65cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.582167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c01d66-04d2-475b-8f1d-1d5fcdb65cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.582439 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c01d66-04d2-475b-8f1d-1d5fcdb65cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.583693 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c01d66-04d2-475b-8f1d-1d5fcdb65cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.585579 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c01d66-04d2-475b-8f1d-1d5fcdb65cdf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.617859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1294/2563] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:24 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:24.623180 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209e9a1-efd9-4f1d-9a12-bcdd9e4719b6 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.634870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209e9a1-efd9-4f1d-9a12-bcdd9e4719b6 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.718091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821de95-113b-43d5-92a4-1c3821f51519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.718706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821de95-113b-43d5-92a4-1c3821f51519 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.719009 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821de95-113b-43d5-92a4-1c3821f51519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.719278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821de95-113b-43d5-92a4-1c3821f51519 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.719931 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821de95-113b-43d5-92a4-1c3821f51519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.721902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821de95-113b-43d5-92a4-1c3821f51519 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.746592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1270/2564] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:24 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:24.753341 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c01d66-04d2-475b-8f1d-1d5fcdb65cdf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.766563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c01d66-04d2-475b-8f1d-1d5fcdb65cdf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.771887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9694d5-ce11-444a-bec6-f083be09438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.772623 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9694d5-ce11-444a-bec6-f083be09438e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.773264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9694d5-ce11-444a-bec6-f083be09438e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.773264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9694d5-ce11-444a-bec6-f083be09438e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.774062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9694d5-ce11-444a-bec6-f083be09438e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.775971 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9694d5-ce11-444a-bec6-f083be09438e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.790820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1295/2565] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:24.795197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821de95-113b-43d5-92a4-1c3821f51519 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.806672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821de95-113b-43d5-92a4-1c3821f51519 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.812402 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d48b4c-317e-4bc7-a33a-b3108923014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.813034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d48b4c-317e-4bc7-a33a-b3108923014b admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.813394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d48b4c-317e-4bc7-a33a-b3108923014b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.814300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d48b4c-317e-4bc7-a33a-b3108923014b admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.814300 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d48b4c-317e-4bc7-a33a-b3108923014b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.816228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d48b4c-317e-4bc7-a33a-b3108923014b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.827384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1271/2566] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:24.832123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9694d5-ce11-444a-bec6-f083be09438e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:24.844175 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9694d5-ce11-444a-bec6-f083be09438e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:24.849049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643a1a6-0401-422b-8b85-23d72885ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:24.850009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643a1a6-0401-422b-8b85-23d72885ebe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.850378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643a1a6-0401-422b-8b85-23d72885ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.850720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643a1a6-0401-422b-8b85-23d72885ebe4 admin admin] PATH_INFO: `/v3/projects/7323de74a4d945dfaab5d01dac438b54/users/bbc3e2ee11d54a5e8240730c8f6487b2/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.868362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643a1a6-0401-422b-8b85-23d72885ebe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7323de74a4d945dfaab5d01dac438b54, user_id=bbc3e2ee11d54a5e8240730c8f6487b2, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:24.871442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643a1a6-0401-422b-8b85-23d72885ebe4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:24.888394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1296/2567] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:24 2022] PUT /identity/v3/projects/7323de74a4d945dfaab5d01dac438b54/users/bbc3e2ee11d54a5e8240730c8f6487b2/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:24.900389 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49ae8-a4d9-4f32-90d4-cd911e4292d0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:24.900742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49ae8-a4d9-4f32-90d4-cd911e4292d0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:24.901136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49ae8-a4d9-4f32-90d4-cd911e4292d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:24.933369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-14f49ae8-a4d9-4f32-90d4-cd911e4292d0 None None] MFA Rules not processed for user `bbc3e2ee11d54a5e8240730c8f6487b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:24.935365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-14f49ae8-a4d9-4f32-90d4-cd911e4292d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:25.016672 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1272/2568] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:25.017852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643a1a6-0401-422b-8b85-23d72885ebe4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:25.088837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:25.094459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643a1a6-0401-422b-8b85-23d72885ebe4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:25.101537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a795-f19a-4230-9762-67fe47a4ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:25.102348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a795-f19a-4230-9762-67fe47a4ec99 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.104144 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a795-f19a-4230-9762-67fe47a4ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.104759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a795-f19a-4230-9762-67fe47a4ec99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.105775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a795-f19a-4230-9762-67fe47a4ec99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:25.108531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a795-f19a-4230-9762-67fe47a4ec99 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:25.139532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1297/2569] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:25 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:25.143254 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f49ae8-a4d9-4f32-90d4-cd911e4292d0 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:25.155020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f49ae8-a4d9-4f32-90d4-cd911e4292d0 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:25.207635 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:25.221796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14582d9d-5c05-463f-9117-225b75e56b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:25.222332 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14582d9d-5c05-463f-9117-225b75e56b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.223063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14582d9d-5c05-463f-9117-225b75e56b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.223063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14582d9d-5c05-463f-9117-225b75e56b2f admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.223553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14582d9d-5c05-463f-9117-225b75e56b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:25.225457 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14582d9d-5c05-463f-9117-225b75e56b2f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:25.250213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1273/2570] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:25 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:25.254634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a795-f19a-4230-9762-67fe47a4ec99 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:25.267494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a795-f19a-4230-9762-67fe47a4ec99 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:25.273219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984d166-0fe5-450a-a11a-d114a8a41978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:25.273988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984d166-0fe5-450a-a11a-d114a8a41978 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.274643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984d166-0fe5-450a-a11a-d114a8a41978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.275105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984d166-0fe5-450a-a11a-d114a8a41978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.275887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984d166-0fe5-450a-a11a-d114a8a41978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:25.277685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984d166-0fe5-450a-a11a-d114a8a41978 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:25.291508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1298/2571] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:25.296943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14582d9d-5c05-463f-9117-225b75e56b2f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:25.308015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14582d9d-5c05-463f-9117-225b75e56b2f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:25.313384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff634ec-ba8a-49c1-b2a5-6b6152d5d0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:25.314042 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff634ec-ba8a-49c1-b2a5-6b6152d5d0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.314317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff634ec-ba8a-49c1-b2a5-6b6152d5d0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.314587 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff634ec-ba8a-49c1-b2a5-6b6152d5d0aa admin admin] PATH_INFO: `/v3/projects/64d0e8f3f04747aa8426c0986441d221/users/03d313fb538545ff94feace2c58fa8be/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.330577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff634ec-ba8a-49c1-b2a5-6b6152d5d0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d0e8f3f04747aa8426c0986441d221, user_id=03d313fb538545ff94feace2c58fa8be, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:25.333298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff634ec-ba8a-49c1-b2a5-6b6152d5d0aa admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:25.347678 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1274/2572] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:25 2022] PUT /identity/v3/projects/64d0e8f3f04747aa8426c0986441d221/users/03d313fb538545ff94feace2c58fa8be/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:25.351648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984d166-0fe5-450a-a11a-d114a8a41978 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:25.364316 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984d166-0fe5-450a-a11a-d114a8a41978 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:25.431189 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ea5a3-5a8e-48d4-9ff3-dd470ecae751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:25.431789 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea5a3-5a8e-48d4-9ff3-dd470ecae751 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.432065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea5a3-5a8e-48d4-9ff3-dd470ecae751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.432333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea5a3-5a8e-48d4-9ff3-dd470ecae751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.432964 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ea5a3-5a8e-48d4-9ff3-dd470ecae751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:25.435200 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ea5a3-5a8e-48d4-9ff3-dd470ecae751 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:25.445775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1299/2573] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:25.450060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff634ec-ba8a-49c1-b2a5-6b6152d5d0aa admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:25.460399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff634ec-ba8a-49c1-b2a5-6b6152d5d0aa admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:25.465004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:25.465755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.466037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.466488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] PATH_INFO: `/v3/projects/64d0e8f3f04747aa8426c0986441d221/users/03d313fb538545ff94feace2c58fa8be/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.468519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d0e8f3f04747aa8426c0986441d221, user_id=03d313fb538545ff94feace2c58fa8be, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:25.471185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:25.482649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1275/2574] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:25 2022] PUT /identity/v3/projects/64d0e8f3f04747aa8426c0986441d221/users/03d313fb538545ff94feace2c58fa8be/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:25.492975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1cd8f-616c-48f7-ad5f-b48ceb7fdfb7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.493261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1cd8f-616c-48f7-ad5f-b48ceb7fdfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.493533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1cd8f-616c-48f7-ad5f-b48ceb7fdfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.526192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0ec1cd8f-616c-48f7-ad5f-b48ceb7fdfb7 None None] MFA Rules not processed for user `03d313fb538545ff94feace2c58fa8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:25.527451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0ec1cd8f-616c-48f7-ad5f-b48ceb7fdfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:25.612912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1300/2575] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:25.624824 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:25.626685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:25.704958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2dc19-a8c2-4886-b84d-0e05adbec235 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:25.709027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:25.709742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.710094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.710455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.721947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:25.723522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:25.735558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1276/2576] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:25.798243 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1cd8f-616c-48f7-ad5f-b48ceb7fdfb7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:25.799660 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0ec1cd8f-616c-48f7-ad5f-b48ceb7fdfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:25.813834 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1cd8f-616c-48f7-ad5f-b48ceb7fdfb7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:25.818127 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517e38d-11e5-41aa-8510-c51f02f76fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:25.819070 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517e38d-11e5-41aa-8510-c51f02f76fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:25.819333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517e38d-11e5-41aa-8510-c51f02f76fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:25.819703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517e38d-11e5-41aa-8510-c51f02f76fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:25.879713 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:25.889889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517e38d-11e5-41aa-8510-c51f02f76fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:25.891386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517e38d-11e5-41aa-8510-c51f02f76fb0 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:25.901945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1301/2577] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:27.447326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:27.449017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:27.548142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55668e-59bc-4c2f-b7ea-d79468ab0e3b service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:27.554852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bde7e-04b0-4831-bd33-4838db5e29de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:27.556475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bde7e-04b0-4831-bd33-4838db5e29de service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:27.556577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bde7e-04b0-4831-bd33-4838db5e29de service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:27.556873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bde7e-04b0-4831-bd33-4838db5e29de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:27.560712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-658bde7e-04b0-4831-bd33-4838db5e29de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:27.582278 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bde7e-04b0-4831-bd33-4838db5e29de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:27.584007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bde7e-04b0-4831-bd33-4838db5e29de service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:27.616091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1277/2578] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:29.039503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517e38d-11e5-41aa-8510-c51f02f76fb0 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:29.113145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517e38d-11e5-41aa-8510-c51f02f76fb0 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:29.118919 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:29.119687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:29.120062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:29.120429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] PATH_INFO: `/v3/users/ab019f93a9764b92a017d4359670d3a9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:29.121731 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab019f93a9764b92a017d4359670d3a9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:29.123797 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:29.182018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab019f93a9764b92a017d4359670d3a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.196572 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab019f93a9764b92a017d4359670d3a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.197396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab019f93a9764b92a017d4359670d3a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.198041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab019f93a9764b92a017d4359670d3a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.211330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab019f93a9764b92a017d4359670d3a9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.230726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1302/2579] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:29 2022] DELETE /identity/v3/users/ab019f93a9764b92a017d4359670d3a9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:29.235529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d938d-4647-446b-96c3-ebd522dc3f1b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:29.236003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d938d-4647-446b-96c3-ebd522dc3f1b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:29.236099 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d938d-4647-446b-96c3-ebd522dc3f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:29.255251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-554d938d-4647-446b-96c3-ebd522dc3f1b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:29.257201 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-554d938d-4647-446b-96c3-ebd522dc3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:29.290680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:29.320440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1278/2580] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:29.331941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:29.333369 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:29.393904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc3c5a-464b-4334-8df3-0d148b6437b8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:29.397667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:29.398475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:29.398745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:29.399072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:29.409037 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:29.410673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:29.423393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1303/2581] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:29.484253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d938d-4647-446b-96c3-ebd522dc3f1b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:29.486390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-554d938d-4647-446b-96c3-ebd522dc3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:29.580815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d938d-4647-446b-96c3-ebd522dc3f1b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:29.583732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:29.584352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:29.584629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:29.584897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:29.586699 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:29.598786 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:29.600348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:29.600465 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:29.602079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:29.614706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1279/2582] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:29.630659 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5f6e1-8db7-4966-b331-50169aeb06e0 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:29.637265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:29.638464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:29.638783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:29.639360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] PATH_INFO: `/v3/users/e5cce01c978f43029c17fd696e1a2bc3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:29.640449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5cce01c978f43029c17fd696e1a2bc3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:29.642633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:29.651121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:29.721286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5cce01c978f43029c17fd696e1a2bc3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.733251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5cce01c978f43029c17fd696e1a2bc3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.733898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5cce01c978f43029c17fd696e1a2bc3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.736378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5cce01c978f43029c17fd696e1a2bc3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.744345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5cce01c978f43029c17fd696e1a2bc3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.757561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:29.759523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:29.763244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1304/2583] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:29 2022] DELETE /identity/v3/users/e5cce01c978f43029c17fd696e1a2bc3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:29.775452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f29b89-1ae3-4472-93b3-ecc00a5974bf service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:29.841610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:29.842243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:29.842515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:29.842811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] PATH_INFO: `/v3/projects/f4ebd0b9119d4063b3bdc337b3122c5d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:29.843959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ebd0b9119d4063b3bdc337b3122c5d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:29.845890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:29.915532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ebd0b9119d4063b3bdc337b3122c5d', 'request_id': 'req-8ba43612-f5a6-49ac-831e-b6747dd78107'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.931376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ebd0b9119d4063b3bdc337b3122c5d', 'request_id': 'req-8ba43612-f5a6-49ac-831e-b6747dd78107'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.961813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ebd0b9119d4063b3bdc337b3122c5d', 'request_id': 'req-8ba43612-f5a6-49ac-831e-b6747dd78107'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.972371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:29.977901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] The token cache is being invalidate because project f4ebd0b9119d4063b3bdc337b3122c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:29.978666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.979605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:29.979769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:29.981901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:29.985951 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1280/2584] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:29 2022] DELETE /identity/v3/projects/f4ebd0b9119d4063b3bdc337b3122c5d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:29.986481 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:29.988957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:30.018888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a19a7-0bf3-4314-8248-53e34789e1fa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.077038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba43612-f5a6-49ac-831e-b6747dd78107 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.085010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.085736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.086231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.086787 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] PATH_INFO: `/v3/users/bbc3e2ee11d54a5e8240730c8f6487b2` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.088298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc3e2ee11d54a5e8240730c8f6487b2)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.090319 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.109078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.110364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.110975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.112069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] PATH_INFO: `/v3/projects/08ef3fedfe424355ab19e0b5011a9922` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.114821 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ef3fedfe424355ab19e0b5011a9922)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.117101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.166438 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc3e2ee11d54a5e8240730c8f6487b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.178835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc3e2ee11d54a5e8240730c8f6487b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.180253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc3e2ee11d54a5e8240730c8f6487b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.181296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc3e2ee11d54a5e8240730c8f6487b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.194043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ef3fedfe424355ab19e0b5011a9922', 'request_id': 'req-a4edee82-232a-4e45-be72-b8e7d30efd6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.194452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-dee21707-e4f9-4f7d-918f-cc309ebaaef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc3e2ee11d54a5e8240730c8f6487b2'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.200202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ef3fedfe424355ab19e0b5011a9922', 'request_id': 'req-a4edee82-232a-4e45-be72-b8e7d30efd6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.211957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ef3fedfe424355ab19e0b5011a9922', 'request_id': 'req-a4edee82-232a-4e45-be72-b8e7d30efd6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.226683 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] The token cache is being invalidate because project 08ef3fedfe424355ab19e0b5011a9922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:30.227092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1281/2585] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:29 2022] DELETE /identity/v3/users/bbc3e2ee11d54a5e8240730c8f6487b2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:30.230165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.231917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a4edee82-232a-4e45-be72-b8e7d30efd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.234841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1305/2586] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:29 2022] DELETE /identity/v3/projects/08ef3fedfe424355ab19e0b5011a9922 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:30.239901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacece33-6ebc-4f52-86b8-702cdbe064c7 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.240395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacece33-6ebc-4f52-86b8-702cdbe064c7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.240476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacece33-6ebc-4f52-86b8-702cdbe064c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.267523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-eacece33-6ebc-4f52-86b8-702cdbe064c7 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:30.269161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-eacece33-6ebc-4f52-86b8-702cdbe064c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:30.374894 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1282/2587] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:30.380615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db2b8-662c-494e-8991-1bea1ba04aca None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.381311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db2b8-662c-494e-8991-1bea1ba04aca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.381311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db2b8-662c-494e-8991-1bea1ba04aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.410685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cf8db2b8-662c-494e-8991-1bea1ba04aca None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:30.412599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cf8db2b8-662c-494e-8991-1bea1ba04aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:30.422889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1306/2588] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:06:30.427509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacece33-6ebc-4f52-86b8-702cdbe064c7 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:30.444502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacece33-6ebc-4f52-86b8-702cdbe064c7 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.461203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.462459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.462459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.462792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.463270 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:06:30.463570 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.465196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.498809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1283/2589] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:06:30.499388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8db2b8-662c-494e-8991-1bea1ba04aca None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:30.509891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8db2b8-662c-494e-8991-1bea1ba04aca None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.529777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.531196 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.531758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.532254 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.533187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.535656 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.541962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:30.571443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1307/2590] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:30 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:30.576393 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:30.584677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:30.589423 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af571a25-bbf7-42e1-b9e6-017bd3226aec admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.657881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:30.659560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:30.662523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2350b03-4523-4804-bdb8-23836025e8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.663289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2350b03-4523-4804-bdb8-23836025e8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.663706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2350b03-4523-4804-bdb8-23836025e8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.664893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2350b03-4523-4804-bdb8-23836025e8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.665984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2350b03-4523-4804-bdb8-23836025e8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.668253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2350b03-4523-4804-bdb8-23836025e8b8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.686320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbd31c-107c-40c8-b357-13fbd2955744 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.692595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.693229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.693505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.694278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] PATH_INFO: `/v3/projects/7323de74a4d945dfaab5d01dac438b54` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.695913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1284/2591] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:30 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:30.700215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2350b03-4523-4804-bdb8-23836025e8b8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:30.703898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7323de74a4d945dfaab5d01dac438b54)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.706091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.712001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2350b03-4523-4804-bdb8-23836025e8b8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.717564 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cc5df-d2ea-4462-9f5c-6a070e6edc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.717963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc5df-d2ea-4462-9f5c-6a070e6edc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.718437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc5df-d2ea-4462-9f5c-6a070e6edc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.718725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc5df-d2ea-4462-9f5c-6a070e6edc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.719509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cc5df-d2ea-4462-9f5c-6a070e6edc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.721225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cc5df-d2ea-4462-9f5c-6a070e6edc62 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.733208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1285/2592] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:30.736925 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cc5df-d2ea-4462-9f5c-6a070e6edc62 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:30.747641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cc5df-d2ea-4462-9f5c-6a070e6edc62 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.764633 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7323de74a4d945dfaab5d01dac438b54', 'request_id': 'req-1c2bdb06-9435-4eff-a370-b14d30a5a831'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.771866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7323de74a4d945dfaab5d01dac438b54', 'request_id': 'req-1c2bdb06-9435-4eff-a370-b14d30a5a831'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.781020 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7323de74a4d945dfaab5d01dac438b54', 'request_id': 'req-1c2bdb06-9435-4eff-a370-b14d30a5a831'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.798435 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] The token cache is being invalidate because project 7323de74a4d945dfaab5d01dac438b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:30.798435 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.798966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:30.800974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1308/2593] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:30 2022] DELETE /identity/v3/projects/7323de74a4d945dfaab5d01dac438b54 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:30.804682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:30.806619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:30.826323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.826974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.827257 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.827532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.828205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.830073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.841317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1286/2594] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:06:30.845383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:30.849220 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:30.871391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14564a6-dbcb-447a-86bf-7afa21fdc28e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.880050 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb1935-a459-4e21-a470-2b0b24f99dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.881532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1935-a459-4e21-a470-2b0b24f99dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.882033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1935-a459-4e21-a470-2b0b24f99dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.883055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1935-a459-4e21-a470-2b0b24f99dc1 admin admin] PATH_INFO: `/v3/projects/dd613ed3a4174659b2f1fc5242ebff5c/users/6448ed94c69a467ca4128fb82c2b08de/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.909302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb1935-a459-4e21-a470-2b0b24f99dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd613ed3a4174659b2f1fc5242ebff5c, user_id=6448ed94c69a467ca4128fb82c2b08de, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.912559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb1935-a459-4e21-a470-2b0b24f99dc1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.918245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bdb06-9435-4eff-a370-b14d30a5a831 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:30.926006 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:30.927276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.927717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.928246 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] PATH_INFO: `/v3/users/03d313fb538545ff94feace2c58fa8be` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.929748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d313fb538545ff94feace2c58fa8be)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:30.934866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1287/2595] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:30 2022] PUT /identity/v3/projects/dd613ed3a4174659b2f1fc5242ebff5c/users/6448ed94c69a467ca4128fb82c2b08de/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:30.936215 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:30.950677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79920a-4866-404d-a744-af71db2db687 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:30.950963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79920a-4866-404d-a744-af71db2db687 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:30.951235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79920a-4866-404d-a744-af71db2db687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:30.972252 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-ec79920a-4866-404d-a744-af71db2db687 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:30.973552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ec79920a-4866-404d-a744-af71db2db687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:31.014617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d313fb538545ff94feace2c58fa8be'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.024465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d313fb538545ff94feace2c58fa8be'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.026207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d313fb538545ff94feace2c58fa8be'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.027073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d313fb538545ff94feace2c58fa8be'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.036332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d313fb538545ff94feace2c58fa8be'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.054005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:31.054949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:31.069410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1309/2596] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:30 2022] DELETE /identity/v3/users/03d313fb538545ff94feace2c58fa8be => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:31.078937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1288/2597] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:31.086493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:31.088030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:31.186983 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d867-03af-45b5-8497-a48e247ad997 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:31.190941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdb422-619c-4efb-ac48-a430a61fda7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:31.191669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdb422-619c-4efb-ac48-a430a61fda7b service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:31.192703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdb422-619c-4efb-ac48-a430a61fda7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:31.192703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdb422-619c-4efb-ac48-a430a61fda7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:31.287788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdb422-619c-4efb-ac48-a430a61fda7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:31.289220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdb422-619c-4efb-ac48-a430a61fda7b service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:31.301937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1310/2598] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:06:31.459795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79920a-4866-404d-a744-af71db2db687 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:31.461475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ec79920a-4866-404d-a744-af71db2db687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:31.488217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79920a-4866-404d-a744-af71db2db687 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:31.511636 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:31.512756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:31.513045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:31.513394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] PATH_INFO: `/v3/projects/64d0e8f3f04747aa8426c0986441d221` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:31.514981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d0e8f3f04747aa8426c0986441d221)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:31.516906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:31.658820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d0e8f3f04747aa8426c0986441d221', 'request_id': 'req-6796532a-2b62-496c-971e-0d5295b18fd1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.673466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d0e8f3f04747aa8426c0986441d221', 'request_id': 'req-6796532a-2b62-496c-971e-0d5295b18fd1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.688013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d0e8f3f04747aa8426c0986441d221', 'request_id': 'req-6796532a-2b62-496c-971e-0d5295b18fd1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.709801 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] The token cache is being invalidate because project 64d0e8f3f04747aa8426c0986441d221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:31.710205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.710987 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:31.714717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1289/2599] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:31 2022] DELETE /identity/v3/projects/64d0e8f3f04747aa8426c0986441d221 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:31.722768 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8ee4-ab38-423f-ac76-15297eaecd34 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:31.724199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8ee4-ab38-423f-ac76-15297eaecd34 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:31.724631 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8ee4-ab38-423f-ac76-15297eaecd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:31.759466 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8c6a8ee4-ab38-423f-ac76-15297eaecd34 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:31.764961 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8c6a8ee4-ab38-423f-ac76-15297eaecd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:31.817785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:31.819321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:31.928745 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796532a-2b62-496c-971e-0d5295b18fd1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:31.936291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:31.937784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:31.938068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:31.938342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] PATH_INFO: `/v3/users/7afbe858bd4c49ab9d7c2dbaed62aa6f` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:31.944208 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afbe858bd4c49ab9d7c2dbaed62aa6f)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:31.946162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:31.960416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1311/2600] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:31.969142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e49c-9c8e-4165-9289-9db70c6603e0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:31.970874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e49c-9c8e-4165-9289-9db70c6603e0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:31.971288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e49c-9c8e-4165-9289-9db70c6603e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.000049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b476e49c-9c8e-4165-9289-9db70c6603e0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:32.001237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b476e49c-9c8e-4165-9289-9db70c6603e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:32.011036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1312/2601] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:32.016576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476e49c-9c8e-4165-9289-9db70c6603e0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.020489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afbe858bd4c49ab9d7c2dbaed62aa6f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.027069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476e49c-9c8e-4165-9289-9db70c6603e0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.029429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afbe858bd4c49ab9d7c2dbaed62aa6f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.030250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afbe858bd4c49ab9d7c2dbaed62aa6f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.030839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afbe858bd4c49ab9d7c2dbaed62aa6f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.034442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.035599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.035903 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.036166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.037263 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:06:32.037580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.039227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.039341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afbe858bd4c49ab9d7c2dbaed62aa6f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.052146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1313/2602] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:06:32.056720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.057305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:32.059430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:32.065246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1290/2603] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:31 2022] DELETE /identity/v3/users/7afbe858bd4c49ab9d7c2dbaed62aa6f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:32.073702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3323c95-c542-4410-9965-2f22501704e1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.094554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:32.144524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.145145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.145432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.145732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.146339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.148540 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.181460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1314/2604] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:32 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:32.186966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.198064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09ecc-713f-4bc6-bd03-411e7d495f90 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.273740 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.276432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:32.289268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df3b7-f98f-49e9-aa08-c985cb9fdc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.289975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df3b7-f98f-49e9-aa08-c985cb9fdc62 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.291126 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df3b7-f98f-49e9-aa08-c985cb9fdc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.291483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df3b7-f98f-49e9-aa08-c985cb9fdc62 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.292343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df3b7-f98f-49e9-aa08-c985cb9fdc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.295162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df3b7-f98f-49e9-aa08-c985cb9fdc62 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.329857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1291/2605] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:32 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:32.334175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df3b7-f98f-49e9-aa08-c985cb9fdc62 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.348984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df3b7-f98f-49e9-aa08-c985cb9fdc62 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.354505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1fa82-80bf-4a9b-821f-ae12aba4fdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.355383 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1fa82-80bf-4a9b-821f-ae12aba4fdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.355759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1fa82-80bf-4a9b-821f-ae12aba4fdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.356490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1fa82-80bf-4a9b-821f-ae12aba4fdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.357248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1fa82-80bf-4a9b-821f-ae12aba4fdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.358985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1fa82-80bf-4a9b-821f-ae12aba4fdd5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.382245 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1292/2606] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:32.386091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1fa82-80bf-4a9b-821f-ae12aba4fdd5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.393001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9181-f433-433c-8208-bebccf9a79d1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.398043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.398580 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.398945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.399220 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] PATH_INFO: `/v3/projects/b801b0abbad24aa4a3fb502a00f5fee1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.400392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b801b0abbad24aa4a3fb502a00f5fee1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.400981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1fa82-80bf-4a9b-821f-ae12aba4fdd5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.402599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.407028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9010ab-cd7d-457b-8370-2c671eb5a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.407837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9010ab-cd7d-457b-8370-2c671eb5a86a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.408193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9010ab-cd7d-457b-8370-2c671eb5a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.408543 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9010ab-cd7d-457b-8370-2c671eb5a86a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.409630 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9010ab-cd7d-457b-8370-2c671eb5a86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.412097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9010ab-cd7d-457b-8370-2c671eb5a86a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.425455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1293/2607] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:06:32.430065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9010ab-cd7d-457b-8370-2c671eb5a86a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.442901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9010ab-cd7d-457b-8370-2c671eb5a86a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.448533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73b2fa-df76-45e2-8771-a06ac492c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.449522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b2fa-df76-45e2-8771-a06ac492c095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.450853 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b2fa-df76-45e2-8771-a06ac492c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.451191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b2fa-df76-45e2-8771-a06ac492c095 admin admin] PATH_INFO: `/v3/projects/10cbcc476b06431fb623dd831df6dd9e/users/4ce67ffb26204aa1bbf28751747e5624/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.471172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73b2fa-df76-45e2-8771-a06ac492c095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cbcc476b06431fb623dd831df6dd9e, user_id=4ce67ffb26204aa1bbf28751747e5624, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.475469 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73b2fa-df76-45e2-8771-a06ac492c095 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.493442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1294/2608] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:32 2022] PUT /identity/v3/projects/10cbcc476b06431fb623dd831df6dd9e/users/4ce67ffb26204aa1bbf28751747e5624/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:32.512151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd508e6-e738-403a-8905-155961028ab5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.512151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd508e6-e738-403a-8905-155961028ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.512151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd508e6-e738-403a-8905-155961028ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.515197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b801b0abbad24aa4a3fb502a00f5fee1', 'request_id': 'req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.525644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b801b0abbad24aa4a3fb502a00f5fee1', 'request_id': 'req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.539780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b801b0abbad24aa4a3fb502a00f5fee1', 'request_id': 'req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.561101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] The token cache is being invalidate because project b801b0abbad24aa4a3fb502a00f5fee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:32.561101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.561790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.561913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3fd508e6-e738-403a-8905-155961028ab5 None None] MFA Rules not processed for user `4ce67ffb26204aa1bbf28751747e5624`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:32.563317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3fd508e6-e738-403a-8905-155961028ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:32.564247 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1315/2609] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:32 2022] DELETE /identity/v3/projects/b801b0abbad24aa4a3fb502a00f5fee1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:06:32.568645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.570573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:32.615881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:32.663467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1295/2610] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:32.663905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eeeb8-2ffe-4944-b4f0-774fbdefae2b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.666613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd508e6-e738-403a-8905-155961028ab5 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.668627 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3fd508e6-e738-403a-8905-155961028ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:32.720962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:32.752107 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.752860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.753208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.753686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] PATH_INFO: `/v3/users/f38eeedfb34e40d79f3d89582de80d28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.754991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38eeedfb34e40d79f3d89582de80d28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.757904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.768288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd508e6-e738-403a-8905-155961028ab5 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.774375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ced01-9d21-447a-ad0e-71709b3d1fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.775218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ced01-9d21-447a-ad0e-71709b3d1fee admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.775499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ced01-9d21-447a-ad0e-71709b3d1fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.775830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ced01-9d21-447a-ad0e-71709b3d1fee admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.777018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ced01-9d21-447a-ad0e-71709b3d1fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.779551 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ced01-9d21-447a-ad0e-71709b3d1fee admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:32.816331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1296/2611] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:32 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:32.817311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ced01-9d21-447a-ad0e-71709b3d1fee admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:32.823686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38eeedfb34e40d79f3d89582de80d28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.835182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38eeedfb34e40d79f3d89582de80d28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.836124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38eeedfb34e40d79f3d89582de80d28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.836761 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38eeedfb34e40d79f3d89582de80d28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.845805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38eeedfb34e40d79f3d89582de80d28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:32.874788 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1316/2612] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:32 2022] DELETE /identity/v3/users/f38eeedfb34e40d79f3d89582de80d28 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:32.906136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ced01-9d21-447a-ad0e-71709b3d1fee admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:32.982793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff17476-38cd-474d-b088-86d7ac61685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:32.983802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17476-38cd-474d-b088-86d7ac61685d admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:32.984281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17476-38cd-474d-b088-86d7ac61685d admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:32.984628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17476-38cd-474d-b088-86d7ac61685d admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:32.985493 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff17476-38cd-474d-b088-86d7ac61685d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:32.988887 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff17476-38cd-474d-b088-86d7ac61685d admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:33.024051 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1297/2613] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:32 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:33.025299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:33.027841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:33.048650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574118c-56a4-4c57-99f7-6cfe0f65c5ea admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:33.056848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:33.057478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:33.057757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:33.058031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:33.060758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:33.063091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:33.082984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1317/2614] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:06:33.083929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff17476-38cd-474d-b088-86d7ac61685d admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:33.105483 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff17476-38cd-474d-b088-86d7ac61685d admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:33.122125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679eced-8ae1-4f15-922b-8be72227c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:33.123388 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eced-8ae1-4f15-922b-8be72227c1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:33.123884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eced-8ae1-4f15-922b-8be72227c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:33.124232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eced-8ae1-4f15-922b-8be72227c1e8 admin admin] PATH_INFO: `/v3/projects/0d487754bf9f4f7d9ac35ae6e58114b8/users/b6d872964c65410abf94badae1015bbf/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:33.135812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:33.137872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:33.157519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f4458-03bd-413d-adbd-4ae8a9e44d32 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:33.161005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679eced-8ae1-4f15-922b-8be72227c1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d487754bf9f4f7d9ac35ae6e58114b8, user_id=b6d872964c65410abf94badae1015bbf, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:33.163601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:33.164203 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679eced-8ae1-4f15-922b-8be72227c1e8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:33.164326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:33.164508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:33.164782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] PATH_INFO: `/v3/projects/a686d3ab24f04bb2b0f177744615a4d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:33.166347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a686d3ab24f04bb2b0f177744615a4d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:33.169222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:33.190129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1298/2615] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:33 2022] PUT /identity/v3/projects/0d487754bf9f4f7d9ac35ae6e58114b8/users/b6d872964c65410abf94badae1015bbf/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:33.203189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679eced-8ae1-4f15-922b-8be72227c1e8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:33.231663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:33.237250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a686d3ab24f04bb2b0f177744615a4d7', 'request_id': 'req-19658adb-edee-45e2-b7d2-757fc71122c5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:33.250345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a686d3ab24f04bb2b0f177744615a4d7', 'request_id': 'req-19658adb-edee-45e2-b7d2-757fc71122c5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:33.261365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:33.266294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a686d3ab24f04bb2b0f177744615a4d7', 'request_id': 'req-19658adb-edee-45e2-b7d2-757fc71122c5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:33.290452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] The token cache is being invalidate because project a686d3ab24f04bb2b0f177744615a4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:33.291138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:33.291636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:33.298829 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1318/2616] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:33 2022] DELETE /identity/v3/projects/a686d3ab24f04bb2b0f177744615a4d7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:33.368981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679eced-8ae1-4f15-922b-8be72227c1e8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:33.448759 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3767aa6-601f-4bfc-9a73-87938495ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:33.449000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767aa6-601f-4bfc-9a73-87938495ff79 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:33.449275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767aa6-601f-4bfc-9a73-87938495ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:33.449615 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767aa6-601f-4bfc-9a73-87938495ff79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:33.450425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3767aa6-601f-4bfc-9a73-87938495ff79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:33.452374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3767aa6-601f-4bfc-9a73-87938495ff79 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:33.464366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1299/2617] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:33.469747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:33.471514 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:33.489162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19658adb-edee-45e2-b7d2-757fc71122c5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:33.495147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:33.497032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:33.497311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:33.497664 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] PATH_INFO: `/v3/projects/0d487754bf9f4f7d9ac35ae6e58114b8/users/b6d872964c65410abf94badae1015bbf/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:33.505978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d487754bf9f4f7d9ac35ae6e58114b8, user_id=b6d872964c65410abf94badae1015bbf, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:33.510192 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:33.564527 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1319/2618] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:33 2022] PUT /identity/v3/projects/0d487754bf9f4f7d9ac35ae6e58114b8/users/b6d872964c65410abf94badae1015bbf/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:33.577148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49457a36-0cd7-4d63-8805-51316694f613 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:33.577710 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49457a36-0cd7-4d63-8805-51316694f613 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:33.577907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49457a36-0cd7-4d63-8805-51316694f613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:33.613848 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-49457a36-0cd7-4d63-8805-51316694f613 None None] MFA Rules not processed for user `b6d872964c65410abf94badae1015bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:33.615154 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-49457a36-0cd7-4d63-8805-51316694f613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:33.710134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1300/2619] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:33.721985 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:33.723861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:33.912922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30b7fd-7eba-4951-a108-e894946ddd46 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:33.916696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c60e4-5aaf-4f61-93d9-86d625332900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:33.917299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c60e4-5aaf-4f61-93d9-86d625332900 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:33.917569 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c60e4-5aaf-4f61-93d9-86d625332900 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:33.917832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c60e4-5aaf-4f61-93d9-86d625332900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:33.929734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c60e4-5aaf-4f61-93d9-86d625332900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:33.931195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c60e4-5aaf-4f61-93d9-86d625332900 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:33.942077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1320/2620] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:34.041062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49457a36-0cd7-4d63-8805-51316694f613 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:34.051445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49457a36-0cd7-4d63-8805-51316694f613 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:34.055790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303dcf4-2e01-40b7-945d-044a4bde102a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:34.056518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303dcf4-2e01-40b7-945d-044a4bde102a service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:34.056999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303dcf4-2e01-40b7-945d-044a4bde102a service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:34.057351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303dcf4-2e01-40b7-945d-044a4bde102a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:34.059949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a303dcf4-2e01-40b7-945d-044a4bde102a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:34.128569 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=100 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:34.133236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303dcf4-2e01-40b7-945d-044a4bde102a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:34.136397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303dcf4-2e01-40b7-945d-044a4bde102a service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:34.148449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1301/2621] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:34.536029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c60e4-5aaf-4f61-93d9-86d625332900 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:34.620803 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c60e4-5aaf-4f61-93d9-86d625332900 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:34.626260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:34.627072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:34.627417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:34.627758 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] PATH_INFO: `/v3/users/4ce67ffb26204aa1bbf28751747e5624` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:34.629481 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce67ffb26204aa1bbf28751747e5624)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:34.648089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:34.721860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce67ffb26204aa1bbf28751747e5624'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:34.747431 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce67ffb26204aa1bbf28751747e5624'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:34.748469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce67ffb26204aa1bbf28751747e5624'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:34.749318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce67ffb26204aa1bbf28751747e5624'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:34.759866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce67ffb26204aa1bbf28751747e5624'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:34.761972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:34.801051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1321/2622] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:34 2022] DELETE /identity/v3/users/4ce67ffb26204aa1bbf28751747e5624 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:34.806395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccb69-3659-4339-bcb1-5c2b64b2f608 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:34.807629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccb69-3659-4339-bcb1-5c2b64b2f608 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:34.808127 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccb69-3659-4339-bcb1-5c2b64b2f608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:34.839614 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-bbeccb69-3659-4339-bcb1-5c2b64b2f608 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:34.842458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bbeccb69-3659-4339-bcb1-5c2b64b2f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:34.968389 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1302/2623] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:34.977847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:34.979940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:35.077564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286b59-5675-4e7d-afce-c849d208e076 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:35.080974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c33ba3-d875-4300-864e-157c46af87cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:35.081832 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33ba3-d875-4300-864e-157c46af87cc service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:35.082211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33ba3-d875-4300-864e-157c46af87cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:35.082712 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33ba3-d875-4300-864e-157c46af87cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:35.097074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c33ba3-d875-4300-864e-157c46af87cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:35.099607 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c33ba3-d875-4300-864e-157c46af87cc service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:35.124494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1322/2624] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:35.445588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeccb69-3659-4339-bcb1-5c2b64b2f608 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:35.447060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-bbeccb69-3659-4339-bcb1-5c2b64b2f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:35.460619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeccb69-3659-4339-bcb1-5c2b64b2f608 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:35.477487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:35.478150 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:35.478431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:35.478703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] PATH_INFO: `/v3/projects/10cbcc476b06431fb623dd831df6dd9e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:35.479870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cbcc476b06431fb623dd831df6dd9e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:35.481834 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:35.556926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cbcc476b06431fb623dd831df6dd9e', 'request_id': 'req-145c61d8-7ba9-47bd-a6f2-9bff87720093'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.570881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cbcc476b06431fb623dd831df6dd9e', 'request_id': 'req-145c61d8-7ba9-47bd-a6f2-9bff87720093'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.586174 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cbcc476b06431fb623dd831df6dd9e', 'request_id': 'req-145c61d8-7ba9-47bd-a6f2-9bff87720093'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.602735 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] The token cache is being invalidate because project 10cbcc476b06431fb623dd831df6dd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:35.603262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.604067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.610796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1303/2625] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:35 2022] DELETE /identity/v3/projects/10cbcc476b06431fb623dd831df6dd9e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:35.612233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c33ba3-d875-4300-864e-157c46af87cc service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:35.628361 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c33ba3-d875-4300-864e-157c46af87cc service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:35.718400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:35.719307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:35.719595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:35.720059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] PATH_INFO: `/v3/users/b6d872964c65410abf94badae1015bbf` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:35.721067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d872964c65410abf94badae1015bbf)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:35.724289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:35.787703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d872964c65410abf94badae1015bbf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.795503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d872964c65410abf94badae1015bbf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.796927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d872964c65410abf94badae1015bbf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.797561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d872964c65410abf94badae1015bbf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.805300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9edb26d9-48a9-4c8e-a11f-e59fb763a1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d872964c65410abf94badae1015bbf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:35.828753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1323/2626] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:35 2022] DELETE /identity/v3/users/b6d872964c65410abf94badae1015bbf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:36.183649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:36.185620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:36.207211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c61d8-7ba9-47bd-a6f2-9bff87720093 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:36.279166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823617-fa05-46cc-8464-1da1d2560451 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.279453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823617-fa05-46cc-8464-1da1d2560451 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.279726 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823617-fa05-46cc-8464-1da1d2560451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.287792 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:36.289702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.290148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.290496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] PATH_INFO: `/v3/projects/0d487754bf9f4f7d9ac35ae6e58114b8` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.291832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d487754bf9f4f7d9ac35ae6e58114b8)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:36.295052 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:36.305648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:36.324157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:36.332563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-29823617-fa05-46cc-8464-1da1d2560451 None None] MFA Rules not processed for user `6448ed94c69a467ca4128fb82c2b08de`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:36.334075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-29823617-fa05-46cc-8464-1da1d2560451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:36.363313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d487754bf9f4f7d9ac35ae6e58114b8', 'request_id': 'req-9f5fcd22-ae2c-4367-a587-2321deeadd91'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:36.369908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d487754bf9f4f7d9ac35ae6e58114b8', 'request_id': 'req-9f5fcd22-ae2c-4367-a587-2321deeadd91'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:36.380528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d487754bf9f4f7d9ac35ae6e58114b8', 'request_id': 'req-9f5fcd22-ae2c-4367-a587-2321deeadd91'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:36.395262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] The token cache is being invalidate because project 0d487754bf9f4f7d9ac35ae6e58114b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:36.395509 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:36.396090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-9f5fcd22-ae2c-4367-a587-2321deeadd91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:36.397961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1304/2627] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:36 2022] DELETE /identity/v3/projects/0d487754bf9f4f7d9ac35ae6e58114b8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:36.402626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c89de-5e8f-41ed-a0dc-bac350ba35c5 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.403403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c89de-5e8f-41ed-a0dc-bac350ba35c5 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.403878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c89de-5e8f-41ed-a0dc-bac350ba35c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.408160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1324/2628] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:36.429835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823617-fa05-46cc-8464-1da1d2560451 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:36.431645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-29823617-fa05-46cc-8464-1da1d2560451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:36.439456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-f45c89de-5e8f-41ed-a0dc-bac350ba35c5 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:36.440976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f45c89de-5e8f-41ed-a0dc-bac350ba35c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:36.530232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1305/2629] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:06:36.545253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c402-1d87-41d9-b4ed-0ab1a4bbfb9b None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.545533 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c402-1d87-41d9-b4ed-0ab1a4bbfb9b None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.545804 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c402-1d87-41d9-b4ed-0ab1a4bbfb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.549550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823617-fa05-46cc-8464-1da1d2560451 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:36.577711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1048c402-1d87-41d9-b4ed-0ab1a4bbfb9b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:36.578981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1048c402-1d87-41d9-b4ed-0ab1a4bbfb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:36.591272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1306/2630] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:36.592343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c402-1d87-41d9-b4ed-0ab1a4bbfb9b None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:36.601663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c402-1d87-41d9-b4ed-0ab1a4bbfb9b None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:36.607317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:36.608132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.608585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.609006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.609856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:06:36.610301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:36.612326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:36.631121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1307/2631] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:06:36.631881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:36.646410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:36.647201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.647551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.647895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.649747 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:36.655901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5a2e-bce6-423c-a930-c27ca22657c5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:36.665007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0379df5-3ea7-4ea4-b5d9-e6fea1d41269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:36.665871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0379df5-3ea7-4ea4-b5d9-e6fea1d41269 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.666491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0379df5-3ea7-4ea4-b5d9-e6fea1d41269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.667006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0379df5-3ea7-4ea4-b5d9-e6fea1d41269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.667842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0379df5-3ea7-4ea4-b5d9-e6fea1d41269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:36.670899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0379df5-3ea7-4ea4-b5d9-e6fea1d41269 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:36.691417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:36.708898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1308/2632] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:06:36 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:06:36.712556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0379df5-3ea7-4ea4-b5d9-e6fea1d41269 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:36.733108 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:36.734775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:36.757508 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1325/2633] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:36.794070 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0379df5-3ea7-4ea4-b5d9-e6fea1d41269 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:36.799916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c206d-273a-49d8-b6cd-f3f3be5e081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:36.800781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c206d-273a-49d8-b6cd-f3f3be5e081a admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.801213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c206d-273a-49d8-b6cd-f3f3be5e081a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.801633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c206d-273a-49d8-b6cd-f3f3be5e081a admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.802436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c206d-273a-49d8-b6cd-f3f3be5e081a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:36.804637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c206d-273a-49d8-b6cd-f3f3be5e081a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:36.825105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:36.831819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1309/2634] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:06:36 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:06:36.836117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:36.849109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d482d-2379-464d-8aa7-c44665cba597 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:36.854928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e7977-5e63-4057-bf6d-6a276248e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:36.856261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e7977-5e63-4057-bf6d-6a276248e824 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.856480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e7977-5e63-4057-bf6d-6a276248e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.856566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e7977-5e63-4057-bf6d-6a276248e824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.857373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e7977-5e63-4057-bf6d-6a276248e824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:36.859122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e7977-5e63-4057-bf6d-6a276248e824 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:36.869817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1326/2635] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:36.874501 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c206d-273a-49d8-b6cd-f3f3be5e081a admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:36.885491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c206d-273a-49d8-b6cd-f3f3be5e081a admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:36.892029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0fe6-0484-4e5d-85b8-0db8713ceec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:36.892632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0fe6-0484-4e5d-85b8-0db8713ceec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.893571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0fe6-0484-4e5d-85b8-0db8713ceec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.893571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0fe6-0484-4e5d-85b8-0db8713ceec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.893808 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0fe6-0484-4e5d-85b8-0db8713ceec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:36.895912 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0fe6-0484-4e5d-85b8-0db8713ceec9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:36.909480 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1310/2636] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:06:36.913804 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e7977-5e63-4057-bf6d-6a276248e824 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:36.924626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e7977-5e63-4057-bf6d-6a276248e824 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:36.929401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:36.929988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:36.930257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:36.930521 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] PATH_INFO: `/v3/projects/c01bf93d8d7d40aabb4808db7d7477a0/users/403d8f19a9494f5fafcf5188f7142cac/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:36.947702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01bf93d8d7d40aabb4808db7d7477a0, user_id=403d8f19a9494f5fafcf5188f7142cac, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:36.951287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:36.968568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1327/2637] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:06:36 2022] PUT /identity/v3/projects/c01bf93d8d7d40aabb4808db7d7477a0/users/403d8f19a9494f5fafcf5188f7142cac/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:37.045938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173151c4-07cb-497b-b860-eff524073a81 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:37.046231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173151c4-07cb-497b-b860-eff524073a81 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:37.046508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173151c4-07cb-497b-b860-eff524073a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:37.076285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-173151c4-07cb-497b-b860-eff524073a81 None None] MFA Rules not processed for user `403d8f19a9494f5fafcf5188f7142cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:37.077528 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-173151c4-07cb-497b-b860-eff524073a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:37.145530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1311/2638] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:37.156948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:37.158661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:37.224760 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cb2ad-0188-458a-9bc8-e00c746f18c6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:37.228271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2652bee-942a-4451-8be2-55378717cc20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:37.228866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2652bee-942a-4451-8be2-55378717cc20 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:37.229139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2652bee-942a-4451-8be2-55378717cc20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:37.229525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2652bee-942a-4451-8be2-55378717cc20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:37.240717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2652bee-942a-4451-8be2-55378717cc20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:37.242641 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2652bee-942a-4451-8be2-55378717cc20 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:37.254230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1328/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:37.285588 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173151c4-07cb-497b-b860-eff524073a81 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:37.358452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173151c4-07cb-497b-b860-eff524073a81 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:37.363307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:37.364462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:37.364462 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:37.364652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] PATH_INFO: `/v3/users/403d8f19a9494f5fafcf5188f7142cac` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:37.365763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=403d8f19a9494f5fafcf5188f7142cac)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:37.368989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:37.423791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403d8f19a9494f5fafcf5188f7142cac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:37.431719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403d8f19a9494f5fafcf5188f7142cac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:37.432399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403d8f19a9494f5fafcf5188f7142cac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:37.433039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403d8f19a9494f5fafcf5188f7142cac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:37.441219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403d8f19a9494f5fafcf5188f7142cac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:37.454247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:37.467143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1312/2640] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:06:37 2022] DELETE /identity/v3/users/403d8f19a9494f5fafcf5188f7142cac => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:37.468779 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f144-007c-4814-ac7c-609a45e090df None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:37.469106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f144-007c-4814-ac7c-609a45e090df None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:37.469376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f144-007c-4814-ac7c-609a45e090df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:37.489889 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9855f144-007c-4814-ac7c-609a45e090df None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:37.491052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9855f144-007c-4814-ac7c-609a45e090df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:37.558386 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1329/2641] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:37.568680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:37.570204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:37.634906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2f385-9cf4-4639-8ae5-80e5fbdaa463 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:37.639917 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21e992-bedc-4ace-b448-0e121733b2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:37.640399 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e992-bedc-4ace-b448-0e121733b2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:37.640986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e992-bedc-4ace-b448-0e121733b2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:37.640986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e992-bedc-4ace-b448-0e121733b2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:37.657060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21e992-bedc-4ace-b448-0e121733b2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:37.658518 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21e992-bedc-4ace-b448-0e121733b2f2 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:37.670433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1313/2642] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:38.108734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855f144-007c-4814-ac7c-609a45e090df None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:38.110274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9855f144-007c-4814-ac7c-609a45e090df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:38.124954 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855f144-007c-4814-ac7c-609a45e090df None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:38.134368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:38.135187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:38.135555 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:38.135916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] PATH_INFO: `/v3/projects/c01bf93d8d7d40aabb4808db7d7477a0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:38.137362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01bf93d8d7d40aabb4808db7d7477a0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:38.140086 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:38.186117 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:38.201743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01bf93d8d7d40aabb4808db7d7477a0', 'request_id': 'req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:38.209140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01bf93d8d7d40aabb4808db7d7477a0', 'request_id': 'req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:38.217892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01bf93d8d7d40aabb4808db7d7477a0', 'request_id': 'req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:38.229838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] The token cache is being invalidate because project c01bf93d8d7d40aabb4808db7d7477a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:06:38.230126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:38.232498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:06:38.245444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1330/2643] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:06:38 2022] DELETE /identity/v3/projects/c01bf93d8d7d40aabb4808db7d7477a0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:06:38.261984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a85294-a7b9-4380-8d33-238ac193976f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:38.263043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a85294-a7b9-4380-8d33-238ac193976f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:38.263324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a85294-a7b9-4380-8d33-238ac193976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:38.288789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b5a85294-a7b9-4380-8d33-238ac193976f None None] MFA Rules not processed for user `6448ed94c69a467ca4128fb82c2b08de`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:38.290034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b5a85294-a7b9-4380-8d33-238ac193976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:38.355207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1314/2644] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:06:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:38.723208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:38.724612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:38.784566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d861ea1-5b2f-43aa-ba8d-217bc645e6ec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:38.788160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:38.788756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:38.789035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:38.789305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:38.791047 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:38.801255 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:38.802920 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:38.811565 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1331/2645] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:39.399408 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a85294-a7b9-4380-8d33-238ac193976f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:39.400850 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b5a85294-a7b9-4380-8d33-238ac193976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:39.520216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a85294-a7b9-4380-8d33-238ac193976f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:39.525361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:39.526031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:39.526371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:39.526707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:39.530556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:39.551681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:39.554478 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:39.566996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1315/2646] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:42.190773 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:42.194033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:42.283030 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324d32b-4980-4fc6-8a13-8f7a177c3c40 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:42.288620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:42.289226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:42.289505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:42.289776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:42.291576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:42.304667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:42.306223 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:42.317141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1332/2647] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:06:46.529534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:46.531786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:46.550365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897426a3-be4c-4c9f-b230-1f8964939f7d service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:46.556698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea7b5a-7ed6-425e-805d-5773a7f670db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:46.557851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7b5a-7ed6-425e-805d-5773a7f670db service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:46.557851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7b5a-7ed6-425e-805d-5773a7f670db service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:46.558063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7b5a-7ed6-425e-805d-5773a7f670db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:46.560561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-aaea7b5a-7ed6-425e-805d-5773a7f670db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:46.577992 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea7b5a-7ed6-425e-805d-5773a7f670db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:46.579796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea7b5a-7ed6-425e-805d-5773a7f670db service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:46.592646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1316/2648] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:50.016158 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:50.027098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795edc-0266-41f1-acfc-bcd642ef6a56 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:50.033620 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:50.034233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:50.034502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:50.034806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:50.036589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:50.049228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:50.050810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:50.061503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1333/2649] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:06:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:06:56.582289 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cc54-66aa-4aa7-8981-4200711cf0e1 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:56.582796 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cc54-66aa-4aa7-8981-4200711cf0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:56.582910 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cc54-66aa-4aa7-8981-4200711cf0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:56.587611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:56.603688 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-3391cc54-66aa-4aa7-8981-4200711cf0e1 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:06:56.604902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3391cc54-66aa-4aa7-8981-4200711cf0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:56.668586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1317/2650] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:06:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:06:56.681895 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:06:56.683458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:06:56.723771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:56.754460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584111e-6e95-4ca8-b241-b36e6a283c86 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:06:56.759346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b9b0e-74e7-484d-b34d-3f0367eec42a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:06:56.759930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b9b0e-74e7-484d-b34d-3f0367eec42a service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:06:56.760204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b9b0e-74e7-484d-b34d-3f0367eec42a service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:06:56.760467 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b9b0e-74e7-484d-b34d-3f0367eec42a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:06:56.768648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b9b0e-74e7-484d-b34d-3f0367eec42a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:06:56.770203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b9b0e-74e7-484d-b34d-3f0367eec42a service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:06:56.777947 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1334/2651] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 05:07:06.660205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=25 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:06.774781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=16 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:10.128815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6333-2142-4f2d-83f8-b0abe522038d None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.129395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6333-2142-4f2d-83f8-b0abe522038d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.129395 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6333-2142-4f2d-83f8-b0abe522038d None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.130919 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1318/2652] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 05:07:10.136826 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee64bd-85bb-4441-842d-6e91ac34f582 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.137793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee64bd-85bb-4441-842d-6e91ac34f582 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.138597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee64bd-85bb-4441-842d-6e91ac34f582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.160274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-baee64bd-85bb-4441-842d-6e91ac34f582 None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:07:10.161691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-baee64bd-85bb-4441-842d-6e91ac34f582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:10.171601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1335/2653] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:07:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:07:10.183538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f6333-2142-4f2d-83f8-b0abe522038d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:10.185314 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a68f6333-2142-4f2d-83f8-b0abe522038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:10.247460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f6333-2142-4f2d-83f8-b0abe522038d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:10.252007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb76fac-a136-46b3-ab99-fb926eb27fbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:10.252702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76fac-a136-46b3-ab99-fb926eb27fbb service glance] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.252982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76fac-a136-46b3-ab99-fb926eb27fbb service glance] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.253253 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76fac-a136-46b3-ab99-fb926eb27fbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.264794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb76fac-a136-46b3-ab99-fb926eb27fbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:10.266519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb76fac-a136-46b3-ab99-fb926eb27fbb service glance] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:10.278601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1319/2654] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:07:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:07:10.351073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d26b-bc89-4a72-888b-a89ff5ea79ec None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.351273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d26b-bc89-4a72-888b-a89ff5ea79ec None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.351556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d26b-bc89-4a72-888b-a89ff5ea79ec None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.352958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1336/2655] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 05:07:10.358621 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ec62f-28e1-474e-9fbf-10ee880d10b9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.358970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ec62f-28e1-474e-9fbf-10ee880d10b9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.359274 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ec62f-28e1-474e-9fbf-10ee880d10b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.381572 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-961ec62f-28e1-474e-9fbf-10ee880d10b9 None None] MFA Rules not processed for user `f50dc809ff034866a1f6343e5b32609b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:07:10.382869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-961ec62f-28e1-474e-9fbf-10ee880d10b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:10.390746 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1320/2656] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:07:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:07:10.403400 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307d26b-bc89-4a72-888b-a89ff5ea79ec None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:10.405214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3307d26b-bc89-4a72-888b-a89ff5ea79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:10.419434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307d26b-bc89-4a72-888b-a89ff5ea79ec None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:10.424404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedea0d-cb09-43b3-a956-67de7f11d461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:10.425008 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedea0d-cb09-43b3-a956-67de7f11d461 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.425289 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedea0d-cb09-43b3-a956-67de7f11d461 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.425561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedea0d-cb09-43b3-a956-67de7f11d461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.433317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedea0d-cb09-43b3-a956-67de7f11d461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:10.434793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedea0d-cb09-43b3-a956-67de7f11d461 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:10.444390 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1337/2657] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:07:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:07:10.554905 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974300e5-edbf-40a7-90ad-79e6fa0c6ad7 None None] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.555211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974300e5-edbf-40a7-90ad-79e6fa0c6ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.555650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974300e5-edbf-40a7-90ad-79e6fa0c6ad7 None None] PATH_INFO: `/` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.558191 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1321/2658] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 24 05:07:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 05:07:10.565384 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a887-f899-4991-80a0-ea37ec7fb2ef None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.565781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a887-f899-4991-80a0-ea37ec7fb2ef None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.566124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a887-f899-4991-80a0-ea37ec7fb2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.626588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c506a887-f899-4991-80a0-ea37ec7fb2ef None None] MFA Rules not processed for user `3b877cb99245408b8ca37c9e85eb023e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:07:10.627927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c506a887-f899-4991-80a0-ea37ec7fb2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:10.647085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1338/2659] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 24 05:07:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:07:10.660326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974300e5-edbf-40a7-90ad-79e6fa0c6ad7 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:10.676875 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974300e5-edbf-40a7-90ad-79e6fa0c6ad7 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:10.682169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5213b0-dc76-44a9-a88b-71293dad78b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:10.684377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5213b0-dc76-44a9-a88b-71293dad78b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:10.685075 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5213b0-dc76-44a9-a88b-71293dad78b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:10.685576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5213b0-dc76-44a9-a88b-71293dad78b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:10.702407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5213b0-dc76-44a9-a88b-71293dad78b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:10.704491 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5213b0-dc76-44a9-a88b-71293dad78b8 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:10.738591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1322/2660] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:07:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:07:13.315767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5013-1b84-4806-9fcf-06ce1475c39c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:13.316276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5013-1b84-4806-9fcf-06ce1475c39c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:13.316276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5013-1b84-4806-9fcf-06ce1475c39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:13.339853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f0df5013-1b84-4806-9fcf-06ce1475c39c None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:07:13.341059 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f0df5013-1b84-4806-9fcf-06ce1475c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:13.356842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1339/2661] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 24 05:07:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:07:13.369226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5213b0-dc76-44a9-a88b-71293dad78b8 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:13.381143 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5213b0-dc76-44a9-a88b-71293dad78b8 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:13.386800 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc94b9b-ac6d-4f9b-baab-d6260cd13b68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:13.387394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94b9b-ac6d-4f9b-baab-d6260cd13b68 service swift] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:13.387668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94b9b-ac6d-4f9b-baab-d6260cd13b68 service swift] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:13.387961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94b9b-ac6d-4f9b-baab-d6260cd13b68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:13.397067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc94b9b-ac6d-4f9b-baab-d6260cd13b68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:13.398576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc94b9b-ac6d-4f9b-baab-d6260cd13b68 service swift] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:13.407120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1323/2662] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:07:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:07:15.513208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df5013-1b84-4806-9fcf-06ce1475c39c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:15.526516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df5013-1b84-4806-9fcf-06ce1475c39c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:15.531979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:15.532637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:15.532916 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:15.533186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:15.534913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:15.599937 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:15.601799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:15.613887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1340/2663] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:07:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:07:23.403364 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=41 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:23.582892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc94b9b-ac6d-4f9b-baab-d6260cd13b68 service swift] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:23.595418 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc94b9b-ac6d-4f9b-baab-d6260cd13b68 service swift] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:23.600720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1efc4-be49-4bd2-be03-4fa3fabdafa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:23.601294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1efc4-be49-4bd2-be03-4fa3fabdafa8 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:23.601566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1efc4-be49-4bd2-be03-4fa3fabdafa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:23.601832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1efc4-be49-4bd2-be03-4fa3fabdafa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:23.603619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a9f1efc4-be49-4bd2-be03-4fa3fabdafa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:23.662594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1efc4-be49-4bd2-be03-4fa3fabdafa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:23.664166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1efc4-be49-4bd2-be03-4fa3fabdafa8 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:23.674226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1324/2664] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:07:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:07:23.952762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:23.962250 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6c7d-1207-4736-a583-1a30c488b8bb service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:23.965775 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:23.966394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:23.966689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:23.967609 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:23.969574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:24.031261 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:24.032663 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:24.042214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1341/2665] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:07:28.244204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdacde6-7dcd-4a6f-a58f-ec46bbfd87c9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:28.244719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdacde6-7dcd-4a6f-a58f-ec46bbfd87c9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:28.244842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdacde6-7dcd-4a6f-a58f-ec46bbfd87c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:28.269805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-2fdacde6-7dcd-4a6f-a58f-ec46bbfd87c9 None None] MFA Rules not processed for user `58adf938f17647108c2d652565bf3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:07:28.271404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2fdacde6-7dcd-4a6f-a58f-ec46bbfd87c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:28.279316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1325/2666] 10.222.0.26 () {58 vars in 967 bytes} [Sat Sep 24 05:07:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:07:28.305885 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:28.324640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e201b-218e-406b-8ade-e3a638e0b8c9 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:28.331805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cabc6d-ca1c-4ace-87ec-3c184673ad89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473bfd2bae82474e81232a3bb364e5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:28.332423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cabc6d-ca1c-4ace-87ec-3c184673ad89 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:28.332697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cabc6d-ca1c-4ace-87ec-3c184673ad89 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:28.332966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cabc6d-ca1c-4ace-87ec-3c184673ad89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:28.342662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cabc6d-ca1c-4ace-87ec-3c184673ad89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:28.344485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cabc6d-ca1c-4ace-87ec-3c184673ad89 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:28.358956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1342/2667] 10.222.0.26 () {60 vars in 1384 bytes} [Sat Sep 24 05:07:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 05:07:30.799097 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdacde6-7dcd-4a6f-a58f-ec46bbfd87c9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:30.800573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2fdacde6-7dcd-4a6f-a58f-ec46bbfd87c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:30.816492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdacde6-7dcd-4a6f-a58f-ec46bbfd87c9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:30.821303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:30.822115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:30.822392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:30.822663 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] PATH_INFO: `/v3/users/89e9adac7ad241ee9081ab600342af9b` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:30.823874 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e9adac7ad241ee9081ab600342af9b)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:30.826414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:30.885419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e9adac7ad241ee9081ab600342af9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:30.894045 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e9adac7ad241ee9081ab600342af9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:30.894654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e9adac7ad241ee9081ab600342af9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:30.895275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e9adac7ad241ee9081ab600342af9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:30.902321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e9adac7ad241ee9081ab600342af9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:30.921450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1326/2668] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:07:30 2022] DELETE /identity/v3/users/89e9adac7ad241ee9081ab600342af9b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:07:31.103209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cabc6d-ca1c-4ace-87ec-3c184673ad89 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:31.119075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cabc6d-ca1c-4ace-87ec-3c184673ad89 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:31.166051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:31.180551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:31.181171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:31.181443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:31.181736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] PATH_INFO: `/v3/projects/6cc8bf70b6354bfc8ca06ef29270c0a1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:31.183148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc8bf70b6354bfc8ca06ef29270c0a1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:31.185382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:31.233226 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc8bf70b6354bfc8ca06ef29270c0a1', 'request_id': 'req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.238870 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc8bf70b6354bfc8ca06ef29270c0a1', 'request_id': 'req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.246822 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc8bf70b6354bfc8ca06ef29270c0a1', 'request_id': 'req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.259259 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] The token cache is being invalidate because project 6cc8bf70b6354bfc8ca06ef29270c0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:07:31.259551 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.260206 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.261756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1343/2669] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:07:31 2022] DELETE /identity/v3/projects/6cc8bf70b6354bfc8ca06ef29270c0a1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:07:31.266573 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:31.268020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:31.282335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2afca9-0334-4b0e-86a3-1307187febbd admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:31.340744 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:31.341749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:31.342727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:31.343109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] PATH_INFO: `/v3/users/08bef1ffe89540369203e69fcc06d52d` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:31.344460 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08bef1ffe89540369203e69fcc06d52d)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:31.346443 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:31.351504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:31.397463 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bef1ffe89540369203e69fcc06d52d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.405767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bef1ffe89540369203e69fcc06d52d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.406581 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bef1ffe89540369203e69fcc06d52d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.407228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bef1ffe89540369203e69fcc06d52d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.414695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-df919bcc-ef38-4851-b8a7-5fb513b5d4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bef1ffe89540369203e69fcc06d52d'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.433217 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1327/2670] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:07:31 2022] DELETE /identity/v3/users/08bef1ffe89540369203e69fcc06d52d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:07:31.611793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:07:31.613391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:31.627068 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f465c2-b800-4f7d-b045-eb57dbacd6eb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:07:31.694592 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:07:31.695395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:31.695672 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:31.695948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] PATH_INFO: `/v3/projects/afea937b16e74772860e6f75165cc1ad` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:31.697207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afea937b16e74772860e6f75165cc1ad)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:07:31.699245 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:07:31.749586 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afea937b16e74772860e6f75165cc1ad', 'request_id': 'req-2544734f-0708-4a41-b925-31fe50e202c4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.755188 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afea937b16e74772860e6f75165cc1ad', 'request_id': 'req-2544734f-0708-4a41-b925-31fe50e202c4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.763046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afea937b16e74772860e6f75165cc1ad', 'request_id': 'req-2544734f-0708-4a41-b925-31fe50e202c4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.775406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] The token cache is being invalidate because project afea937b16e74772860e6f75165cc1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:07:31.775688 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.776330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:07:31.777796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1344/2671] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:07:31 2022] DELETE /identity/v3/projects/afea937b16e74772860e6f75165cc1ad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:07:31.900942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43faaee-ddd1-4711-be6c-03351dcbc28d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:07:31.901547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43faaee-ddd1-4711-be6c-03351dcbc28d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:07:31.901547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43faaee-ddd1-4711-be6c-03351dcbc28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:07:31.936279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-a43faaee-ddd1-4711-be6c-03351dcbc28d None None] MFA Rules not processed for user `6448ed94c69a467ca4128fb82c2b08de`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:07:31.937591 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a43faaee-ddd1-4711-be6c-03351dcbc28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:07:32.000251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1328/2672] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:07:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:07:41.772515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:41.992375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:09.821029 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:09.822459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:09.878537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544734f-0708-4a41-b925-31fe50e202c4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:09.882084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:09.882817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:09.883092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:09.883358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:09.885026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:09.946667 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:09.948016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:09.957682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1345/2673] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:13.048890 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43faaee-ddd1-4711-be6c-03351dcbc28d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:13.050372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a43faaee-ddd1-4711-be6c-03351dcbc28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:13.066426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43faaee-ddd1-4711-be6c-03351dcbc28d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:13.070861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:13.071505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.071777 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.072050 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] PATH_INFO: `/v3/users/bfeaaa13b150405787bb0a7ca71ada40` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.073159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfeaaa13b150405787bb0a7ca71ada40)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:13.075084 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:13.121169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfeaaa13b150405787bb0a7ca71ada40'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.129933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfeaaa13b150405787bb0a7ca71ada40'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.130560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfeaaa13b150405787bb0a7ca71ada40'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.131215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfeaaa13b150405787bb0a7ca71ada40'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.138231 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-f7c03e0b-9454-45d9-9c7d-040e54faea86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfeaaa13b150405787bb0a7ca71ada40'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.155371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1329/2674] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:08:13 2022] DELETE /identity/v3/users/bfeaaa13b150405787bb0a7ca71ada40 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:08:13.324282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:13.340461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960fcac-5958-45ce-bad5-03e454eea3c3 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:13.397858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:13.398482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.398781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.399076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] PATH_INFO: `/v3/projects/e3df0f9883e740b0a17ac9931ecc9813` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.400185 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3df0f9883e740b0a17ac9931ecc9813)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:13.402075 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:13.450347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3df0f9883e740b0a17ac9931ecc9813', 'request_id': 'req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.452242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:13.458148 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3df0f9883e740b0a17ac9931ecc9813', 'request_id': 'req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.464547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3df0f9883e740b0a17ac9931ecc9813', 'request_id': 'req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.476444 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] The token cache is being invalidate because project e3df0f9883e740b0a17ac9931ecc9813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:13.476729 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.477357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9bb426fa-68d9-4f3f-b8db-e41b8b85db59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:13.478834 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1346/2675] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:13 2022] DELETE /identity/v3/projects/e3df0f9883e740b0a17ac9931ecc9813 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:13.483628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36ebd5-9403-4e79-bef2-f5f7569cab1d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.483934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36ebd5-9403-4e79-bef2-f5f7569cab1d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.484207 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36ebd5-9403-4e79-bef2-f5f7569cab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.505222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-aa36ebd5-9403-4e79-bef2-f5f7569cab1d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:13.506410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-aa36ebd5-9403-4e79-bef2-f5f7569cab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:13.568313 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1330/2676] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:13.573608 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5d384-e1f6-4a6c-b9d3-b51f51bd38d0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.573887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5d384-e1f6-4a6c-b9d3-b51f51bd38d0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.574159 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5d384-e1f6-4a6c-b9d3-b51f51bd38d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.595326 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d9a5d384-e1f6-4a6c-b9d3-b51f51bd38d0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:13.596534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d9a5d384-e1f6-4a6c-b9d3-b51f51bd38d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:13.604333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1347/2677] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:08:13.608771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36ebd5-9403-4e79-bef2-f5f7569cab1d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:13.619377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36ebd5-9403-4e79-bef2-f5f7569cab1d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:13.623883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:13.624494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.624772 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.625023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.625652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:08:13.626566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:13.628544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:13.645534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1331/2678] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:08:13.649927 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5d384-e1f6-4a6c-b9d3-b51f51bd38d0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:13.660178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5d384-e1f6-4a6c-b9d3-b51f51bd38d0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:13.664900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c0228-b6da-431b-a681-7612a9addb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:13.665522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c0228-b6da-431b-a681-7612a9addb4d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.665798 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c0228-b6da-431b-a681-7612a9addb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.666067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c0228-b6da-431b-a681-7612a9addb4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.666695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c0228-b6da-431b-a681-7612a9addb4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:13.668596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c0228-b6da-431b-a681-7612a9addb4d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:13.695748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1348/2679] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:13 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:13.699921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:13.710793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d85cf1-0749-4539-bb7c-eabed5c0988f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:13.765426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382c48a-7a6e-4915-b22c-0f40e11e8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:13.766017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382c48a-7a6e-4915-b22c-0f40e11e8407 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.766290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382c48a-7a6e-4915-b22c-0f40e11e8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.767568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382c48a-7a6e-4915-b22c-0f40e11e8407 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.768323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382c48a-7a6e-4915-b22c-0f40e11e8407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:13.770216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382c48a-7a6e-4915-b22c-0f40e11e8407 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:13.777994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:13.792489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1332/2680] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:08:13 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:13.796728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c0228-b6da-431b-a681-7612a9addb4d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:13.807032 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c0228-b6da-431b-a681-7612a9addb4d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:13.811848 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02bc0d-172a-4301-b2d1-c70f8de4e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:13.812445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02bc0d-172a-4301-b2d1-c70f8de4e2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.812745 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02bc0d-172a-4301-b2d1-c70f8de4e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.813015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02bc0d-172a-4301-b2d1-c70f8de4e2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.814235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02bc0d-172a-4301-b2d1-c70f8de4e2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:13.815847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02bc0d-172a-4301-b2d1-c70f8de4e2f3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:13.825718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1349/2681] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:08:13.830238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382c48a-7a6e-4915-b22c-0f40e11e8407 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:13.840507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382c48a-7a6e-4915-b22c-0f40e11e8407 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:13.845356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2495f-7db1-41fe-bea4-d20224ec8b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:13.845935 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2495f-7db1-41fe-bea4-d20224ec8b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.846227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2495f-7db1-41fe-bea4-d20224ec8b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.846494 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2495f-7db1-41fe-bea4-d20224ec8b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.847153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2495f-7db1-41fe-bea4-d20224ec8b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:13.848725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2495f-7db1-41fe-bea4-d20224ec8b67 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:13.859990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1333/2682] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:13.864948 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02bc0d-172a-4301-b2d1-c70f8de4e2f3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:13.875368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02bc0d-172a-4301-b2d1-c70f8de4e2f3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:13.880771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8452594-b0fa-48ae-964a-4a7911449f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:13.881409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452594-b0fa-48ae-964a-4a7911449f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.881686 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452594-b0fa-48ae-964a-4a7911449f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.881958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452594-b0fa-48ae-964a-4a7911449f75 admin admin] PATH_INFO: `/v3/projects/a590e0a436564376960a6970e929b256/users/b53a3c2c4e574335944315b42eb142bf/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.900562 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8452594-b0fa-48ae-964a-4a7911449f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a590e0a436564376960a6970e929b256, user_id=b53a3c2c4e574335944315b42eb142bf, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:13.903339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8452594-b0fa-48ae-964a-4a7911449f75 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:13.916204 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1350/2683] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:13 2022] PUT /identity/v3/projects/a590e0a436564376960a6970e929b256/users/b53a3c2c4e574335944315b42eb142bf/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:13.927409 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a6526-0a4b-403c-99a2-2ac5f0a9b68f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:13.927696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a6526-0a4b-403c-99a2-2ac5f0a9b68f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:13.927969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a6526-0a4b-403c-99a2-2ac5f0a9b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:13.955960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-980a6526-0a4b-403c-99a2-2ac5f0a9b68f None None] MFA Rules not processed for user `b53a3c2c4e574335944315b42eb142bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:13.957172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-980a6526-0a4b-403c-99a2-2ac5f0a9b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:14.020504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1334/2684] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:14.025023 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8452594-b0fa-48ae-964a-4a7911449f75 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.084770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8452594-b0fa-48ae-964a-4a7911449f75 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.089264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3015-00ba-4035-8cff-a60df887b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.089850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3015-00ba-4035-8cff-a60df887b873 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.090122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3015-00ba-4035-8cff-a60df887b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.090387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3015-00ba-4035-8cff-a60df887b873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.091109 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b3015-00ba-4035-8cff-a60df887b873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.092959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b3015-00ba-4035-8cff-a60df887b873 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:14.119309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1351/2685] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:14 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:14.123468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a6526-0a4b-403c-99a2-2ac5f0a9b68f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.134720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a6526-0a4b-403c-99a2-2ac5f0a9b68f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.189140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350540c2-8e6b-43cc-a405-94dce0a0abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.189822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350540c2-8e6b-43cc-a405-94dce0a0abcb admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.190106 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350540c2-8e6b-43cc-a405-94dce0a0abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.190375 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350540c2-8e6b-43cc-a405-94dce0a0abcb admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.191026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350540c2-8e6b-43cc-a405-94dce0a0abcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.192929 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350540c2-8e6b-43cc-a405-94dce0a0abcb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:14.213450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1335/2686] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:08:14 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:14.217564 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3015-00ba-4035-8cff-a60df887b873 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.228240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3015-00ba-4035-8cff-a60df887b873 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.233088 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686abbee-7d75-4bd8-ae92-9115bae030ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.233899 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686abbee-7d75-4bd8-ae92-9115bae030ae admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.234178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686abbee-7d75-4bd8-ae92-9115bae030ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.234446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686abbee-7d75-4bd8-ae92-9115bae030ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.235120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686abbee-7d75-4bd8-ae92-9115bae030ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.237330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686abbee-7d75-4bd8-ae92-9115bae030ae admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:14.247680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1352/2687] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:14.251878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350540c2-8e6b-43cc-a405-94dce0a0abcb admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.261799 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350540c2-8e6b-43cc-a405-94dce0a0abcb admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.266344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda30a5f-1f94-4621-bb67-b03cd3b28e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.267335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda30a5f-1f94-4621-bb67-b03cd3b28e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.267611 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda30a5f-1f94-4621-bb67-b03cd3b28e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.267883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda30a5f-1f94-4621-bb67-b03cd3b28e4c admin admin] PATH_INFO: `/v3/projects/582f93923f8945339bfce859d3492d81/users/9a65ebeef050480f9f1138fd84b05c2b/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.282901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda30a5f-1f94-4621-bb67-b03cd3b28e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=582f93923f8945339bfce859d3492d81, user_id=9a65ebeef050480f9f1138fd84b05c2b, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.285709 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda30a5f-1f94-4621-bb67-b03cd3b28e4c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:14.300288 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1336/2688] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:14 2022] PUT /identity/v3/projects/582f93923f8945339bfce859d3492d81/users/9a65ebeef050480f9f1138fd84b05c2b/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:14.304222 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686abbee-7d75-4bd8-ae92-9115bae030ae admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.314119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686abbee-7d75-4bd8-ae92-9115bae030ae admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.359137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:14.371441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be4224-07e6-4a34-86a4-dfb2181276a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.372040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be4224-07e6-4a34-86a4-dfb2181276a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.372312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be4224-07e6-4a34-86a4-dfb2181276a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.372583 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be4224-07e6-4a34-86a4-dfb2181276a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.373209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be4224-07e6-4a34-86a4-dfb2181276a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.374867 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be4224-07e6-4a34-86a4-dfb2181276a1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:14.385348 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1353/2689] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:14.389531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda30a5f-1f94-4621-bb67-b03cd3b28e4c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.400138 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda30a5f-1f94-4621-bb67-b03cd3b28e4c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.404928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.405568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.405867 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.406129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] PATH_INFO: `/v3/projects/582f93923f8945339bfce859d3492d81/users/9a65ebeef050480f9f1138fd84b05c2b/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.408866 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582f93923f8945339bfce859d3492d81, user_id=9a65ebeef050480f9f1138fd84b05c2b, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.411507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:14.423747 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1337/2690] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:14 2022] PUT /identity/v3/projects/582f93923f8945339bfce859d3492d81/users/9a65ebeef050480f9f1138fd84b05c2b/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:14.435769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363fcfd-4d5e-4d03-906c-183404a5e998 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.436106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363fcfd-4d5e-4d03-906c-183404a5e998 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.436379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363fcfd-4d5e-4d03-906c-183404a5e998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.463957 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8363fcfd-4d5e-4d03-906c-183404a5e998 None None] MFA Rules not processed for user `9a65ebeef050480f9f1138fd84b05c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:14.465162 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8363fcfd-4d5e-4d03-906c-183404a5e998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:14.531738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1354/2691] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:14.544467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.546140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:14.568928 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:14.603969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b136ca-d7b2-4d4d-a5e3-66ca28a2edb6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.607547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab06af-343d-4c35-a96c-01f649a8ed0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.608129 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab06af-343d-4c35-a96c-01f649a8ed0b service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.608401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab06af-343d-4c35-a96c-01f649a8ed0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.608666 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab06af-343d-4c35-a96c-01f649a8ed0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.617531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab06af-343d-4c35-a96c-01f649a8ed0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.618923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab06af-343d-4c35-a96c-01f649a8ed0b service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:14.628660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1338/2692] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:14.935056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363fcfd-4d5e-4d03-906c-183404a5e998 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.944219 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363fcfd-4d5e-4d03-906c-183404a5e998 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.948754 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a65ebeef050480f9f1138fd84b05c2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '582f93923f8945339bfce859d3492d81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.949360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.949636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.949905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.950545 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:08:14.950881 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.957897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:14.966268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1355/2693] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:08:14.971620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab06af-343d-4c35-a96c-01f649a8ed0b service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:14.981215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab06af-343d-4c35-a96c-01f649a8ed0b service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:14.985898 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639aab1-fb3f-4d54-b2af-a7a46abf966f tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a65ebeef050480f9f1138fd84b05c2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '582f93923f8945339bfce859d3492d81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:14.986492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639aab1-fb3f-4d54-b2af-a7a46abf966f tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:14.986825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639aab1-fb3f-4d54-b2af-a7a46abf966f tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:14.987083 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639aab1-fb3f-4d54-b2af-a7a46abf966f tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:14.987708 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639aab1-fb3f-4d54-b2af-a7a46abf966f tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:14.989690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639aab1-fb3f-4d54-b2af-a7a46abf966f tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:15.021461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1339/2694] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:14 2022] POST /identity/v3/projects => generated 354 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:15.025332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:15.035735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40220091-a85c-4e52-a1a6-2d0eff040130 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:15.090972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a65ebeef050480f9f1138fd84b05c2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '582f93923f8945339bfce859d3492d81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:15.091570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:15.091850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:15.092125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:15.092765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:08:15.093069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:15.094734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:15.106260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1356/2695] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:08:15.144764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639aab1-fb3f-4d54-b2af-a7a46abf966f tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:15.154926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639aab1-fb3f-4d54-b2af-a7a46abf966f tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:15.159508 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a65ebeef050480f9f1138fd84b05c2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '582f93923f8945339bfce859d3492d81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:15.160125 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:15.160410 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:15.160685 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] PATH_INFO: `/v3/projects/f7340ab207fb4548bf6596ea9b28e2f5` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:15.161811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7340ab207fb4548bf6596ea9b28e2f5)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:15.163749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:15.209852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7340ab207fb4548bf6596ea9b28e2f5', 'request_id': 'req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.215219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7340ab207fb4548bf6596ea9b28e2f5', 'request_id': 'req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.222429 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7340ab207fb4548bf6596ea9b28e2f5', 'request_id': 'req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.234025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] The token cache is being invalidate because project f7340ab207fb4548bf6596ea9b28e2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:15.234335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.235000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-27ebf7ac-98ab-4cb1-9d6c-ef40db431747 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.236495 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1340/2696] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:15 2022] DELETE /identity/v3/projects/f7340ab207fb4548bf6596ea9b28e2f5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:15.423721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:15.425605 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:15.476828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:15.490441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62157c-3624-452d-8493-1b35593a9557 tempest-VolumeQuotaClassesTest-1236620468 tempest-VolumeQuotaClassesTest-1236620468-project-admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:15.544501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:15.545100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:15.545378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:15.545649 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] PATH_INFO: `/v3/users/b53a3c2c4e574335944315b42eb142bf` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:15.546783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53a3c2c4e574335944315b42eb142bf)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:15.549216 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:15.592838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53a3c2c4e574335944315b42eb142bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.600268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53a3c2c4e574335944315b42eb142bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.601062 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53a3c2c4e574335944315b42eb142bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.601759 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53a3c2c4e574335944315b42eb142bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.609392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53a3c2c4e574335944315b42eb142bf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:15.627236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1357/2697] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:08:15 2022] DELETE /identity/v3/users/b53a3c2c4e574335944315b42eb142bf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:15.631892 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b68d-2c69-45cc-9815-23165bf76fb7 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:15.632163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b68d-2c69-45cc-9815-23165bf76fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:15.632681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b68d-2c69-45cc-9815-23165bf76fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:15.653425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-58b7b68d-2c69-45cc-9815-23165bf76fb7 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:15.654557 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-58b7b68d-2c69-45cc-9815-23165bf76fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:15.713884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1341/2698] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:15.724053 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:15.725469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:15.781453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04957476-3bc7-4061-8cee-77ebcb79759d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:15.785640 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874cc9d-e4f5-4cd5-ba33-2511b780ee24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:15.786233 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cc9d-e4f5-4cd5-ba33-2511b780ee24 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:15.786528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cc9d-e4f5-4cd5-ba33-2511b780ee24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:15.786806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cc9d-e4f5-4cd5-ba33-2511b780ee24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:15.795718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874cc9d-e4f5-4cd5-ba33-2511b780ee24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:15.797131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874cc9d-e4f5-4cd5-ba33-2511b780ee24 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:15.807221 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1358/2699] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:16.075377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b68d-2c69-45cc-9815-23165bf76fb7 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:16.076813 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-58b7b68d-2c69-45cc-9815-23165bf76fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:16.093047 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b68d-2c69-45cc-9815-23165bf76fb7 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:16.098851 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:16.099662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:16.099996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:16.100187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] PATH_INFO: `/v3/projects/a590e0a436564376960a6970e929b256` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:16.101346 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a590e0a436564376960a6970e929b256)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:16.103224 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:16.128200 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:16.156229 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a590e0a436564376960a6970e929b256', 'request_id': 'req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.162311 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a590e0a436564376960a6970e929b256', 'request_id': 'req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.169475 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a590e0a436564376960a6970e929b256', 'request_id': 'req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.180593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] The token cache is being invalidate because project a590e0a436564376960a6970e929b256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:16.180883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.181504 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.183019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1342/2700] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:16 2022] DELETE /identity/v3/projects/a590e0a436564376960a6970e929b256 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:16.186975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874cc9d-e4f5-4cd5-ba33-2511b780ee24 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:16.196462 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874cc9d-e4f5-4cd5-ba33-2511b780ee24 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:16.214796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:16.255358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:16.255975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:16.256251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:16.256550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] PATH_INFO: `/v3/users/9a65ebeef050480f9f1138fd84b05c2b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:16.257653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a65ebeef050480f9f1138fd84b05c2b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:16.259570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:16.309420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a65ebeef050480f9f1138fd84b05c2b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.317100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a65ebeef050480f9f1138fd84b05c2b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.317723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a65ebeef050480f9f1138fd84b05c2b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.318309 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a65ebeef050480f9f1138fd84b05c2b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.325133 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2657123-a3d7-4673-ba04-b64583aa7d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a65ebeef050480f9f1138fd84b05c2b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.342382 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1359/2701] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:08:16 2022] DELETE /identity/v3/users/9a65ebeef050480f9f1138fd84b05c2b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:16.615647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:16.617172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:16.633267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83fc79-6ba1-4420-a46b-ef46a7028fe1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:16.692637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:16.693184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:16.693580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:16.693859 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] PATH_INFO: `/v3/projects/582f93923f8945339bfce859d3492d81` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:16.694998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=582f93923f8945339bfce859d3492d81)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:16.696897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:16.743711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582f93923f8945339bfce859d3492d81', 'request_id': 'req-5b0d6850-07e4-4506-aee6-e8a2805cbc67'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.749067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582f93923f8945339bfce859d3492d81', 'request_id': 'req-5b0d6850-07e4-4506-aee6-e8a2805cbc67'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.756593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582f93923f8945339bfce859d3492d81', 'request_id': 'req-5b0d6850-07e4-4506-aee6-e8a2805cbc67'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.768219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] The token cache is being invalidate because project 582f93923f8945339bfce859d3492d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:16.768503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.769130 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5b0d6850-07e4-4506-aee6-e8a2805cbc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:16.770594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1343/2702] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:16 2022] DELETE /identity/v3/projects/582f93923f8945339bfce859d3492d81 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:16.775541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9772-865c-450c-b965-1441bacb2a81 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:16.776078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9772-865c-450c-b965-1441bacb2a81 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:16.776078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9772-865c-450c-b965-1441bacb2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:16.796345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0f7e9772-865c-450c-b965-1441bacb2a81 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:16.797532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f7e9772-865c-450c-b965-1441bacb2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:16.856240 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1360/2703] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:16.864444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08acd-7f77-4445-8a36-89449b42d75d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:16.864730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08acd-7f77-4445-8a36-89449b42d75d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:16.865000 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08acd-7f77-4445-8a36-89449b42d75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:16.884996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-53e08acd-7f77-4445-8a36-89449b42d75d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:16.886206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-53e08acd-7f77-4445-8a36-89449b42d75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:16.895079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1344/2704] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:16.899405 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9772-865c-450c-b965-1441bacb2a81 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:16.910043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9772-865c-450c-b965-1441bacb2a81 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:16.914511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:16.915121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:16.915393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:16.915681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:16.916311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:08:16.916604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:16.918164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:16.929738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1361/2705] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:08:16.934055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e08acd-7f77-4445-8a36-89449b42d75d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:16.943617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e08acd-7f77-4445-8a36-89449b42d75d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:16.948111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154724d-b153-41b9-a273-d7c8fb2acae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:16.948694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154724d-b153-41b9-a273-d7c8fb2acae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:16.948974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154724d-b153-41b9-a273-d7c8fb2acae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:16.949242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154724d-b153-41b9-a273-d7c8fb2acae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:16.949872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154724d-b153-41b9-a273-d7c8fb2acae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:16.951786 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154724d-b153-41b9-a273-d7c8fb2acae7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:16.979728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1345/2706] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:16 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:16.983714 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:16.993662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee458-a242-4e64-84db-db1581dd3e98 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.019227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:17.051337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ca5db-bec9-46ac-9fee-c1e6de4ea4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.051926 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ca5db-bec9-46ac-9fee-c1e6de4ea4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.052197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ca5db-bec9-46ac-9fee-c1e6de4ea4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.052461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ca5db-bec9-46ac-9fee-c1e6de4ea4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.053084 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ca5db-bec9-46ac-9fee-c1e6de4ea4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.055002 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ca5db-bec9-46ac-9fee-c1e6de4ea4e3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.076499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1362/2707] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:08:16 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:17.081249 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154724d-b153-41b9-a273-d7c8fb2acae7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.091830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154724d-b153-41b9-a273-d7c8fb2acae7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.096802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5420e1a-3df7-4814-b714-8bfa9416eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.097397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5420e1a-3df7-4814-b714-8bfa9416eab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.097668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5420e1a-3df7-4814-b714-8bfa9416eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.097933 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5420e1a-3df7-4814-b714-8bfa9416eab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.098567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5420e1a-3df7-4814-b714-8bfa9416eab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.100291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5420e1a-3df7-4814-b714-8bfa9416eab8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.102452 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:17.114722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1346/2708] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:17.115588 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ca5db-bec9-46ac-9fee-c1e6de4ea4e3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.127353 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ca5db-bec9-46ac-9fee-c1e6de4ea4e3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.132864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2295c-d2d2-4d3e-be82-ca31d86b8db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.133459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2295c-d2d2-4d3e-be82-ca31d86b8db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.133736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2295c-d2d2-4d3e-be82-ca31d86b8db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.134010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2295c-d2d2-4d3e-be82-ca31d86b8db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.134643 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2295c-d2d2-4d3e-be82-ca31d86b8db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.136266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2295c-d2d2-4d3e-be82-ca31d86b8db4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.147210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1363/2709] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:08:17.151530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5420e1a-3df7-4814-b714-8bfa9416eab8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.161701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5420e1a-3df7-4814-b714-8bfa9416eab8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.166303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b00e3b-4135-4322-842b-e995d1d09aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.166967 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b00e3b-4135-4322-842b-e995d1d09aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.167244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b00e3b-4135-4322-842b-e995d1d09aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.167514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b00e3b-4135-4322-842b-e995d1d09aa7 admin admin] PATH_INFO: `/v3/projects/36d342ae915e44b9875bb225854a422e/users/facdc1c2f0cf4fbea6569918a7c55472/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.182199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b00e3b-4135-4322-842b-e995d1d09aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d342ae915e44b9875bb225854a422e, user_id=facdc1c2f0cf4fbea6569918a7c55472, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.184869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b00e3b-4135-4322-842b-e995d1d09aa7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.198161 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1347/2710] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:17 2022] PUT /identity/v3/projects/36d342ae915e44b9875bb225854a422e/users/facdc1c2f0cf4fbea6569918a7c55472/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:17.208614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0184b-1b0b-462b-9eac-c239b14bce76 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.208898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0184b-1b0b-462b-9eac-c239b14bce76 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.209164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0184b-1b0b-462b-9eac-c239b14bce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.237940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-90f0184b-1b0b-462b-9eac-c239b14bce76 None None] MFA Rules not processed for user `facdc1c2f0cf4fbea6569918a7c55472`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:17.239296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-90f0184b-1b0b-462b-9eac-c239b14bce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:17.301556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1364/2711] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:17.306236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b00e3b-4135-4322-842b-e995d1d09aa7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.365979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b00e3b-4135-4322-842b-e995d1d09aa7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.370555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc58de-0b19-4508-b9b4-d6d80386c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.371177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc58de-0b19-4508-b9b4-d6d80386c45e admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.371455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc58de-0b19-4508-b9b4-d6d80386c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.371720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc58de-0b19-4508-b9b4-d6d80386c45e admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.372335 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc58de-0b19-4508-b9b4-d6d80386c45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.374211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc58de-0b19-4508-b9b4-d6d80386c45e admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.399762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1348/2712] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:17 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:17.403783 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0184b-1b0b-462b-9eac-c239b14bce76 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.414956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0184b-1b0b-462b-9eac-c239b14bce76 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.473621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaabf77-5ca5-45dd-8e44-4e0da00c3685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.474141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabf77-5ca5-45dd-8e44-4e0da00c3685 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.474410 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabf77-5ca5-45dd-8e44-4e0da00c3685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.474673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabf77-5ca5-45dd-8e44-4e0da00c3685 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.475455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaabf77-5ca5-45dd-8e44-4e0da00c3685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.477331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaabf77-5ca5-45dd-8e44-4e0da00c3685 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.498401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1365/2713] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:08:17 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:08:17.502436 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc58de-0b19-4508-b9b4-d6d80386c45e admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.512825 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc58de-0b19-4508-b9b4-d6d80386c45e admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.517769 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348d2d-46da-4017-8a19-fdd384b821f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.518372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348d2d-46da-4017-8a19-fdd384b821f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.518654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348d2d-46da-4017-8a19-fdd384b821f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.518958 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348d2d-46da-4017-8a19-fdd384b821f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.519592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5348d2d-46da-4017-8a19-fdd384b821f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.521167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5348d2d-46da-4017-8a19-fdd384b821f7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.531503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1349/2714] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:17.536485 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaabf77-5ca5-45dd-8e44-4e0da00c3685 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.546599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaabf77-5ca5-45dd-8e44-4e0da00c3685 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.552095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6bf3e-1a16-4efd-bfdf-c36409cf44be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.552842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6bf3e-1a16-4efd-bfdf-c36409cf44be admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.553120 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6bf3e-1a16-4efd-bfdf-c36409cf44be admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.553415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6bf3e-1a16-4efd-bfdf-c36409cf44be admin admin] PATH_INFO: `/v3/projects/50a5acfb2edd42b097653eb0eadd4f51/users/a3498f74086c43ef81bbe0d4901b4562/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.568253 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6bf3e-1a16-4efd-bfdf-c36409cf44be admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a5acfb2edd42b097653eb0eadd4f51, user_id=a3498f74086c43ef81bbe0d4901b4562, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.570917 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6bf3e-1a16-4efd-bfdf-c36409cf44be admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.583796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1366/2715] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:17 2022] PUT /identity/v3/projects/50a5acfb2edd42b097653eb0eadd4f51/users/a3498f74086c43ef81bbe0d4901b4562/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:08:17.587806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348d2d-46da-4017-8a19-fdd384b821f7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.597726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348d2d-46da-4017-8a19-fdd384b821f7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.653372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748616b8-657d-4c03-b19d-1eaa29800345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.653969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748616b8-657d-4c03-b19d-1eaa29800345 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.654244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748616b8-657d-4c03-b19d-1eaa29800345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.654510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748616b8-657d-4c03-b19d-1eaa29800345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.655197 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748616b8-657d-4c03-b19d-1eaa29800345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.656784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748616b8-657d-4c03-b19d-1eaa29800345 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.667215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1350/2716] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:17.671364 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6bf3e-1a16-4efd-bfdf-c36409cf44be admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.677415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:17.685597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6bf3e-1a16-4efd-bfdf-c36409cf44be admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.693407 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.694025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.694298 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.694563 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] PATH_INFO: `/v3/projects/50a5acfb2edd42b097653eb0eadd4f51/users/a3498f74086c43ef81bbe0d4901b4562/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.696478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a5acfb2edd42b097653eb0eadd4f51, user_id=a3498f74086c43ef81bbe0d4901b4562, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.699110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.710089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1367/2717] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:17 2022] PUT /identity/v3/projects/50a5acfb2edd42b097653eb0eadd4f51/users/a3498f74086c43ef81bbe0d4901b4562/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:17.721711 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a4e7f-d646-4f4d-b6e4-203545625cf9 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.721995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a4e7f-d646-4f4d-b6e4-203545625cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.722265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a4e7f-d646-4f4d-b6e4-203545625cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.749932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b42a4e7f-d646-4f4d-b6e4-203545625cf9 None None] MFA Rules not processed for user `a3498f74086c43ef81bbe0d4901b4562`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:17.751739 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b42a4e7f-d646-4f4d-b6e4-203545625cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:17.785524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:17.824484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1351/2718] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:17.836716 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:17.838417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:17.895673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107f83-eac3-4058-9139-c816ba12c620 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:17.899288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df96d-182e-4c72-a271-2a5b00882b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:17.899880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df96d-182e-4c72-a271-2a5b00882b97 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:17.900154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df96d-182e-4c72-a271-2a5b00882b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:17.900422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df96d-182e-4c72-a271-2a5b00882b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:17.909464 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df96d-182e-4c72-a271-2a5b00882b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:17.910906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df96d-182e-4c72-a271-2a5b00882b97 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:17.920050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1368/2719] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:18.003216 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a4e7f-d646-4f4d-b6e4-203545625cf9 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:18.012637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a4e7f-d646-4f4d-b6e4-203545625cf9 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:18.016172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668de4-752a-4a80-adfc-e2fed67da57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:18.017131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668de4-752a-4a80-adfc-e2fed67da57d service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:18.017406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668de4-752a-4a80-adfc-e2fed67da57d service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:18.017674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668de4-752a-4a80-adfc-e2fed67da57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:18.073420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09668de4-752a-4a80-adfc-e2fed67da57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:18.074873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09668de4-752a-4a80-adfc-e2fed67da57d service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:18.083907 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1352/2720] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:22.804452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df96d-182e-4c72-a271-2a5b00882b97 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:22.889553 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df96d-182e-4c72-a271-2a5b00882b97 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:22.896209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:22.896977 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:22.897443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:22.898550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] PATH_INFO: `/v3/users/facdc1c2f0cf4fbea6569918a7c55472` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:22.899236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=facdc1c2f0cf4fbea6569918a7c55472)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:22.901311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:22.978406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'facdc1c2f0cf4fbea6569918a7c55472'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.004324 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'facdc1c2f0cf4fbea6569918a7c55472'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.005489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'facdc1c2f0cf4fbea6569918a7c55472'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.007003 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'facdc1c2f0cf4fbea6569918a7c55472'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.016654 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'facdc1c2f0cf4fbea6569918a7c55472'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.062503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1369/2721] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:08:22 2022] DELETE /identity/v3/users/facdc1c2f0cf4fbea6569918a7c55472 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:23.067406 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b66f0-5c6c-40c5-b2e2-56d209c3f8b4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:23.068580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b66f0-5c6c-40c5-b2e2-56d209c3f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:23.069073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b66f0-5c6c-40c5-b2e2-56d209c3f8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:23.097155 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b93b66f0-5c6c-40c5-b2e2-56d209c3f8b4 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:23.098810 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b93b66f0-5c6c-40c5-b2e2-56d209c3f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:23.182989 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1353/2722] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:23.194073 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:23.195802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:23.215539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:23.288167 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521ec2-6d92-4d74-b9b8-f970c57ea9ca admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:23.293034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74531a3d-e087-4489-ac66-53035a7aa2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:23.293809 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74531a3d-e087-4489-ac66-53035a7aa2ef service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:23.294338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74531a3d-e087-4489-ac66-53035a7aa2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:23.294787 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74531a3d-e087-4489-ac66-53035a7aa2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:23.310399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74531a3d-e087-4489-ac66-53035a7aa2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:23.312327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74531a3d-e087-4489-ac66-53035a7aa2ef service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:23.323174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1370/2723] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:23.617525 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b66f0-5c6c-40c5-b2e2-56d209c3f8b4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:23.619238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b93b66f0-5c6c-40c5-b2e2-56d209c3f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:23.634165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b66f0-5c6c-40c5-b2e2-56d209c3f8b4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:23.639640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:23.640505 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:23.640962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:23.641233 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] PATH_INFO: `/v3/projects/36d342ae915e44b9875bb225854a422e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:23.653908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d342ae915e44b9875bb225854a422e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:23.656485 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:23.709396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d342ae915e44b9875bb225854a422e', 'request_id': 'req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.715764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d342ae915e44b9875bb225854a422e', 'request_id': 'req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.720620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:23.725603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d342ae915e44b9875bb225854a422e', 'request_id': 'req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.740015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] The token cache is being invalidate because project 36d342ae915e44b9875bb225854a422e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:23.740303 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.741004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.742793 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1354/2724] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:23 2022] DELETE /identity/v3/projects/36d342ae915e44b9875bb225854a422e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:23.747048 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74531a3d-e087-4489-ac66-53035a7aa2ef service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:23.757060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74531a3d-e087-4489-ac66-53035a7aa2ef service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:23.817998 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:23.818820 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:23.822987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:23.823368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] PATH_INFO: `/v3/users/a3498f74086c43ef81bbe0d4901b4562` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:23.824715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3498f74086c43ef81bbe0d4901b4562)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:23.826855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:23.876478 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3498f74086c43ef81bbe0d4901b4562'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.884118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3498f74086c43ef81bbe0d4901b4562'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.884721 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3498f74086c43ef81bbe0d4901b4562'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.885403 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3498f74086c43ef81bbe0d4901b4562'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.896089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5014dc98-484a-4f59-b1b9-b33544b75721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3498f74086c43ef81bbe0d4901b4562'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:23.915332 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1371/2725] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:08:23 2022] DELETE /identity/v3/users/a3498f74086c43ef81bbe0d4901b4562 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:08:24.201189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:24.202728 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:24.220431 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9c0f6-a8ef-4d90-adf8-5ba2fb44834c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:24.278854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:24.279472 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.279749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.280022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] PATH_INFO: `/v3/projects/50a5acfb2edd42b097653eb0eadd4f51` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.281132 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a5acfb2edd42b097653eb0eadd4f51)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:24.283218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:24.331121 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a5acfb2edd42b097653eb0eadd4f51', 'request_id': 'req-7c037fbc-e314-4d7e-8713-71c4d038b5ac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:24.336839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a5acfb2edd42b097653eb0eadd4f51', 'request_id': 'req-7c037fbc-e314-4d7e-8713-71c4d038b5ac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:24.345529 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a5acfb2edd42b097653eb0eadd4f51', 'request_id': 'req-7c037fbc-e314-4d7e-8713-71c4d038b5ac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:24.357324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] The token cache is being invalidate because project 50a5acfb2edd42b097653eb0eadd4f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:24.357628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:24.358250 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7c037fbc-e314-4d7e-8713-71c4d038b5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:24.359740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1355/2726] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:24 2022] DELETE /identity/v3/projects/50a5acfb2edd42b097653eb0eadd4f51 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:24.366049 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb0e40-3d7a-4b07-ba63-046cb15ad4d1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.366505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb0e40-3d7a-4b07-ba63-046cb15ad4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.366806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb0e40-3d7a-4b07-ba63-046cb15ad4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.389182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-00eb0e40-3d7a-4b07-ba63-046cb15ad4d1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:24.390420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-00eb0e40-3d7a-4b07-ba63-046cb15ad4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:24.422330 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:24.456855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1372/2727] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:24.464822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfe22-7df2-480c-a849-2cf80cf790ef None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.465107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfe22-7df2-480c-a849-2cf80cf790ef None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.465380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfe22-7df2-480c-a849-2cf80cf790ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.486785 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9a2dfe22-7df2-480c-a849-2cf80cf790ef None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:24.488020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9a2dfe22-7df2-480c-a849-2cf80cf790ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:24.495993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1356/2728] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:24.500617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb0e40-3d7a-4b07-ba63-046cb15ad4d1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:24.512124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb0e40-3d7a-4b07-ba63-046cb15ad4d1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:24.517421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:24.518007 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.518350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.518717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.519339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:08:24.519637 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:24.521453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:24.537115 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1373/2729] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:08:24.538267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dfe22-7df2-480c-a849-2cf80cf790ef None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:24.548131 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dfe22-7df2-480c-a849-2cf80cf790ef None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:24.553285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191d72c-b786-4b93-8968-b29128213d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:24.553915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191d72c-b786-4b93-8968-b29128213d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.554195 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191d72c-b786-4b93-8968-b29128213d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.554467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191d72c-b786-4b93-8968-b29128213d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.555148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191d72c-b786-4b93-8968-b29128213d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:24.557064 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191d72c-b786-4b93-8968-b29128213d4c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:24.590333 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1357/2730] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:24 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:24.594140 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:24.604448 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9cbb-167c-423b-871b-06135b16db8c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:24.666892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35721e4-5140-45d5-b2b3-ba4a996e7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:24.667501 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35721e4-5140-45d5-b2b3-ba4a996e7668 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.667780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35721e4-5140-45d5-b2b3-ba4a996e7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.668051 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35721e4-5140-45d5-b2b3-ba4a996e7668 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.668690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35721e4-5140-45d5-b2b3-ba4a996e7668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:24.670591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35721e4-5140-45d5-b2b3-ba4a996e7668 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:24.694099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1374/2731] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:08:24 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:08:24.698768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191d72c-b786-4b93-8968-b29128213d4c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:24.710585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191d72c-b786-4b93-8968-b29128213d4c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:24.716142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a270a-31b9-4069-bf5b-848e38fbb8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:24.716756 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a270a-31b9-4069-bf5b-848e38fbb8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.717033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a270a-31b9-4069-bf5b-848e38fbb8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.717302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a270a-31b9-4069-bf5b-848e38fbb8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.717941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a270a-31b9-4069-bf5b-848e38fbb8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:24.720236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a270a-31b9-4069-bf5b-848e38fbb8d6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:24.733365 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1358/2732] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:24.734556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35721e4-5140-45d5-b2b3-ba4a996e7668 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:24.744945 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35721e4-5140-45d5-b2b3-ba4a996e7668 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:24.750160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348d77-fc77-478a-bd9f-80807d074b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:24.751965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d77-fc77-478a-bd9f-80807d074b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.751965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d77-fc77-478a-bd9f-80807d074b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.752218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d77-fc77-478a-bd9f-80807d074b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.752756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348d77-fc77-478a-bd9f-80807d074b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:24.754339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348d77-fc77-478a-bd9f-80807d074b1a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:24.765005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1375/2733] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:24.770186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a270a-31b9-4069-bf5b-848e38fbb8d6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:24.780262 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a270a-31b9-4069-bf5b-848e38fbb8d6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:24.784990 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea24b7-45db-4257-a2da-d83200af4149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:24.785642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea24b7-45db-4257-a2da-d83200af4149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.786001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea24b7-45db-4257-a2da-d83200af4149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.786183 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea24b7-45db-4257-a2da-d83200af4149 admin admin] PATH_INFO: `/v3/projects/9704612d618b468fb0ec10db6ce342b3/users/240bd1136c1b4854873ae81e7af83787/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.801181 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea24b7-45db-4257-a2da-d83200af4149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9704612d618b468fb0ec10db6ce342b3, user_id=240bd1136c1b4854873ae81e7af83787, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:24.803865 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea24b7-45db-4257-a2da-d83200af4149 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:24.819532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1359/2734] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:24 2022] PUT /identity/v3/projects/9704612d618b468fb0ec10db6ce342b3/users/240bd1136c1b4854873ae81e7af83787/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:24.830154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54193-d939-481c-8748-359d3e161d3f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:24.830702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54193-d939-481c-8748-359d3e161d3f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:24.830702 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54193-d939-481c-8748-359d3e161d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:24.858706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-68b54193-d939-481c-8748-359d3e161d3f None None] MFA Rules not processed for user `240bd1136c1b4854873ae81e7af83787`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:24.859904 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-68b54193-d939-481c-8748-359d3e161d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:24.927857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1376/2735] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:24.932511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea24b7-45db-4257-a2da-d83200af4149 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:24.952999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:25.002017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea24b7-45db-4257-a2da-d83200af4149 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:25.006765 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a2be5-9c59-4dea-a008-f394d1a6a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:25.007379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2be5-9c59-4dea-a008-f394d1a6a405 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:25.007656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2be5-9c59-4dea-a008-f394d1a6a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:25.007926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2be5-9c59-4dea-a008-f394d1a6a405 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:25.008560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a2be5-9c59-4dea-a008-f394d1a6a405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:25.010445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a2be5-9c59-4dea-a008-f394d1a6a405 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:25.043536 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1360/2736] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:24 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:25.047697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b54193-d939-481c-8748-359d3e161d3f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:25.058876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b54193-d939-481c-8748-359d3e161d3f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:25.086836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:25.119583 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396eb1a-8a59-43fa-818a-0219708de5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:25.120193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396eb1a-8a59-43fa-818a-0219708de5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:25.120470 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396eb1a-8a59-43fa-818a-0219708de5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:25.120741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396eb1a-8a59-43fa-818a-0219708de5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:25.121408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396eb1a-8a59-43fa-818a-0219708de5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:25.123350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396eb1a-8a59-43fa-818a-0219708de5a6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:25.146009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1377/2737] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:08:25 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:25.149384 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a2be5-9c59-4dea-a008-f394d1a6a405 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:25.160638 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a2be5-9c59-4dea-a008-f394d1a6a405 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:25.165358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b07c3-525f-4fb5-bbba-03239c53c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:25.165955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b07c3-525f-4fb5-bbba-03239c53c944 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:25.166236 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b07c3-525f-4fb5-bbba-03239c53c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:25.166510 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b07c3-525f-4fb5-bbba-03239c53c944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:25.167194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b07c3-525f-4fb5-bbba-03239c53c944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:25.168783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b07c3-525f-4fb5-bbba-03239c53c944 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:25.179962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1361/2738] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:25.183995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396eb1a-8a59-43fa-818a-0219708de5a6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:25.194097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396eb1a-8a59-43fa-818a-0219708de5a6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:25.198653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85e003-e2a9-4f14-859b-687594d97507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:25.199322 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85e003-e2a9-4f14-859b-687594d97507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:25.199599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85e003-e2a9-4f14-859b-687594d97507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:25.199864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85e003-e2a9-4f14-859b-687594d97507 admin admin] PATH_INFO: `/v3/projects/978dcbe3f4bd498c822bbd34bf0767ff/users/8d38e80764ff47f2bb2f8654646ef8c1/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:25.216855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85e003-e2a9-4f14-859b-687594d97507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978dcbe3f4bd498c822bbd34bf0767ff, user_id=8d38e80764ff47f2bb2f8654646ef8c1, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:25.220122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85e003-e2a9-4f14-859b-687594d97507 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:25.234723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1378/2739] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:25 2022] PUT /identity/v3/projects/978dcbe3f4bd498c822bbd34bf0767ff/users/8d38e80764ff47f2bb2f8654646ef8c1/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:25.238633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b07c3-525f-4fb5-bbba-03239c53c944 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:25.248835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b07c3-525f-4fb5-bbba-03239c53c944 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:25.327893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa50d-9f46-434e-bd99-670c651bd8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:25.328610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa50d-9f46-434e-bd99-670c651bd8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:25.329974 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa50d-9f46-434e-bd99-670c651bd8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:25.330351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa50d-9f46-434e-bd99-670c651bd8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:25.331255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa50d-9f46-434e-bd99-670c651bd8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:25.333754 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa50d-9f46-434e-bd99-670c651bd8f3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:25.351584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1362/2740] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:25.355774 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85e003-e2a9-4f14-859b-687594d97507 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:25.366285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85e003-e2a9-4f14-859b-687594d97507 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:25.371171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:25.371805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:25.372078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:25.372350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] PATH_INFO: `/v3/projects/978dcbe3f4bd498c822bbd34bf0767ff/users/8d38e80764ff47f2bb2f8654646ef8c1/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:25.374557 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978dcbe3f4bd498c822bbd34bf0767ff, user_id=8d38e80764ff47f2bb2f8654646ef8c1, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:25.377248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:25.387315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1379/2741] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:25 2022] PUT /identity/v3/projects/978dcbe3f4bd498c822bbd34bf0767ff/users/8d38e80764ff47f2bb2f8654646ef8c1/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:08:25.398176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90592f6-a078-41ee-b77f-4b5675cff9bd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:25.398455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90592f6-a078-41ee-b77f-4b5675cff9bd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:25.398722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90592f6-a078-41ee-b77f-4b5675cff9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:25.427379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d90592f6-a078-41ee-b77f-4b5675cff9bd None None] MFA Rules not processed for user `8d38e80764ff47f2bb2f8654646ef8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:25.428597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d90592f6-a078-41ee-b77f-4b5675cff9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:25.494806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1363/2742] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:25.505833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:25.507676 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:25.565748 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a219e2c-ce34-4bc7-9979-0d1ca6627fe8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:25.569434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a5a0c-24c5-44c1-8d8c-47eafe450048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:25.570031 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a5a0c-24c5-44c1-8d8c-47eafe450048 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:25.570306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a5a0c-24c5-44c1-8d8c-47eafe450048 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:25.570573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a5a0c-24c5-44c1-8d8c-47eafe450048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:25.628102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a5a0c-24c5-44c1-8d8c-47eafe450048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:25.629558 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a5a0c-24c5-44c1-8d8c-47eafe450048 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:25.638529 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1380/2743] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:29.892763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90592f6-a078-41ee-b77f-4b5675cff9bd None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:29.894196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d90592f6-a078-41ee-b77f-4b5675cff9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:29.908055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90592f6-a078-41ee-b77f-4b5675cff9bd None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:29.912007 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cea010-e0d8-4ae9-8915-631ad2273f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:29.912703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cea010-e0d8-4ae9-8915-631ad2273f65 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:29.913041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cea010-e0d8-4ae9-8915-631ad2273f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:29.913374 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cea010-e0d8-4ae9-8915-631ad2273f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:29.923522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cea010-e0d8-4ae9-8915-631ad2273f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:29.925025 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cea010-e0d8-4ae9-8915-631ad2273f65 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:29.930737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:29.935713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1364/2744] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:32.247072 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944664-a39a-4a44-b907-3bbbbfffe07c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:32.247582 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944664-a39a-4a44-b907-3bbbbfffe07c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:32.247582 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944664-a39a-4a44-b907-3bbbbfffe07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:32.268420 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7e944664-a39a-4a44-b907-3bbbbfffe07c None None] MFA Rules not processed for user `6448ed94c69a467ca4128fb82c2b08de`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:32.269596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7e944664-a39a-4a44-b907-3bbbbfffe07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:32.298723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:32.325297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1381/2745] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:34.863115 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cea010-e0d8-4ae9-8915-631ad2273f65 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:34.929868 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cea010-e0d8-4ae9-8915-631ad2273f65 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:34.934482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:34.935740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:34.936015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:34.936281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] PATH_INFO: `/v3/users/240bd1136c1b4854873ae81e7af83787` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:34.937398 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=240bd1136c1b4854873ae81e7af83787)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:34.939396 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:34.988381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240bd1136c1b4854873ae81e7af83787'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:34.995837 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240bd1136c1b4854873ae81e7af83787'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:34.996597 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240bd1136c1b4854873ae81e7af83787'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:34.997284 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240bd1136c1b4854873ae81e7af83787'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:35.005477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240bd1136c1b4854873ae81e7af83787'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:35.023998 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1365/2746] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:08:34 2022] DELETE /identity/v3/users/240bd1136c1b4854873ae81e7af83787 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:35.028734 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04e45-3439-43ab-90d2-79474a7a94c1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:35.029229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04e45-3439-43ab-90d2-79474a7a94c1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:35.029408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04e45-3439-43ab-90d2-79474a7a94c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:35.049531 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-afb04e45-3439-43ab-90d2-79474a7a94c1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:35.050905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-afb04e45-3439-43ab-90d2-79474a7a94c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:35.114242 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1382/2747] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:35.121291 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:35.122689 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:35.191896 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d5a8d-1fbd-4795-9c97-820f668df741 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:35.196970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085290d2-943a-4f9f-a0b3-b2bf3e8b1595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:35.197870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085290d2-943a-4f9f-a0b3-b2bf3e8b1595 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:35.198159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085290d2-943a-4f9f-a0b3-b2bf3e8b1595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:35.198434 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085290d2-943a-4f9f-a0b3-b2bf3e8b1595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:35.211566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085290d2-943a-4f9f-a0b3-b2bf3e8b1595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:35.213043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085290d2-943a-4f9f-a0b3-b2bf3e8b1595 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:35.226122 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1366/2748] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:08:35.947875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04e45-3439-43ab-90d2-79474a7a94c1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:35.949454 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-afb04e45-3439-43ab-90d2-79474a7a94c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:35.961404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04e45-3439-43ab-90d2-79474a7a94c1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:35.968043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:35.968722 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:35.968992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:35.970026 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] PATH_INFO: `/v3/projects/9704612d618b468fb0ec10db6ce342b3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:35.971042 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9704612d618b468fb0ec10db6ce342b3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:35.973295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:36.021687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9704612d618b468fb0ec10db6ce342b3', 'request_id': 'req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.027401 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9704612d618b468fb0ec10db6ce342b3', 'request_id': 'req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.035771 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9704612d618b468fb0ec10db6ce342b3', 'request_id': 'req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.047293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] The token cache is being invalidate because project 9704612d618b468fb0ec10db6ce342b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:36.047624 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.048805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.050287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1383/2749] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:35 2022] DELETE /identity/v3/projects/9704612d618b468fb0ec10db6ce342b3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:36.054297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085290d2-943a-4f9f-a0b3-b2bf3e8b1595 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:36.065457 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085290d2-943a-4f9f-a0b3-b2bf3e8b1595 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:36.084708 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:36.126881 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:36.127532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:36.127789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:36.128056 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] PATH_INFO: `/v3/users/8d38e80764ff47f2bb2f8654646ef8c1` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:36.129166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d38e80764ff47f2bb2f8654646ef8c1)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:36.131177 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:36.177403 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d38e80764ff47f2bb2f8654646ef8c1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.184440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d38e80764ff47f2bb2f8654646ef8c1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.185081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d38e80764ff47f2bb2f8654646ef8c1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.185716 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d38e80764ff47f2bb2f8654646ef8c1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.192809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b789135d-c483-4377-a3b6-8a4d44c156b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d38e80764ff47f2bb2f8654646ef8c1'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.209673 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1367/2750] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:08:36 2022] DELETE /identity/v3/users/8d38e80764ff47f2bb2f8654646ef8c1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:36.489208 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:36.490653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:36.510781 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2ebf-c8bd-4791-ba75-27d40bdd1b7c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:36.574898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:36.575522 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:36.575795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:36.576064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] PATH_INFO: `/v3/projects/978dcbe3f4bd498c822bbd34bf0767ff` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:36.577151 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978dcbe3f4bd498c822bbd34bf0767ff)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:36.579755 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:36.586210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:36.626534 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978dcbe3f4bd498c822bbd34bf0767ff', 'request_id': 'req-da42d3e2-c39c-42c0-a351-a100a01907d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.632111 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978dcbe3f4bd498c822bbd34bf0767ff', 'request_id': 'req-da42d3e2-c39c-42c0-a351-a100a01907d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.639205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978dcbe3f4bd498c822bbd34bf0767ff', 'request_id': 'req-da42d3e2-c39c-42c0-a351-a100a01907d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.651986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] The token cache is being invalidate because project 978dcbe3f4bd498c822bbd34bf0767ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:36.652276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.652912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-da42d3e2-c39c-42c0-a351-a100a01907d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:36.654406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1384/2751] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:36 2022] DELETE /identity/v3/projects/978dcbe3f4bd498c822bbd34bf0767ff => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:36.661159 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9632-90cf-4058-a3d5-aafe4a3d2a65 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:36.661447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9632-90cf-4058-a3d5-aafe4a3d2a65 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:36.661727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9632-90cf-4058-a3d5-aafe4a3d2a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:36.681394 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-539b9632-90cf-4058-a3d5-aafe4a3d2a65 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:36.682602 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-539b9632-90cf-4058-a3d5-aafe4a3d2a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:36.741770 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1368/2752] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:36.750452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c0647-8f08-4c28-b0fd-c51d1d403350 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:36.751352 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c0647-8f08-4c28-b0fd-c51d1d403350 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:36.751627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c0647-8f08-4c28-b0fd-c51d1d403350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:36.773671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3c5c0647-8f08-4c28-b0fd-c51d1d403350 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:36.774918 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c5c0647-8f08-4c28-b0fd-c51d1d403350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:36.782861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1385/2753] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:36.787302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b9632-90cf-4058-a3d5-aafe4a3d2a65 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:36.797189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b9632-90cf-4058-a3d5-aafe4a3d2a65 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:36.801937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:36.802532 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:36.802838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:36.803109 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:36.803815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:08:36.804117 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:36.805706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:36.821341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1369/2754] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:08:36.822300 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c0647-8f08-4c28-b0fd-c51d1d403350 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:36.832499 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c0647-8f08-4c28-b0fd-c51d1d403350 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:36.837169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dcb51-a7b8-47ec-a2e4-bcca9ec29d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:36.837756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dcb51-a7b8-47ec-a2e4-bcca9ec29d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:36.838033 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dcb51-a7b8-47ec-a2e4-bcca9ec29d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:36.838301 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dcb51-a7b8-47ec-a2e4-bcca9ec29d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:36.838952 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dcb51-a7b8-47ec-a2e4-bcca9ec29d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:36.840837 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dcb51-a7b8-47ec-a2e4-bcca9ec29d8d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:36.871482 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1386/2755] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:36 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:36.876371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:36.886655 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e66e2-5f4b-40bb-8301-9abf1e1dfec2 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:36.913751 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:36.948433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a43d51-96d8-40a2-b970-8b04263341de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:36.949046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a43d51-96d8-40a2-b970-8b04263341de admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:36.949324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a43d51-96d8-40a2-b970-8b04263341de admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:36.949596 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a43d51-96d8-40a2-b970-8b04263341de admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:36.950228 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a43d51-96d8-40a2-b970-8b04263341de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:36.952171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a43d51-96d8-40a2-b970-8b04263341de admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:36.974085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1370/2756] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:08:36 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:36.978285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dcb51-a7b8-47ec-a2e4-bcca9ec29d8d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:36.988842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dcb51-a7b8-47ec-a2e4-bcca9ec29d8d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:36.993646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2fa05-236e-4a4b-a8c4-09e4450e8f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:36.994252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fa05-236e-4a4b-a8c4-09e4450e8f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:36.994599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fa05-236e-4a4b-a8c4-09e4450e8f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:36.994969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fa05-236e-4a4b-a8c4-09e4450e8f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:36.995678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2fa05-236e-4a4b-a8c4-09e4450e8f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:36.997337 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2fa05-236e-4a4b-a8c4-09e4450e8f1c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:37.008451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1387/2757] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:37.012490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a43d51-96d8-40a2-b970-8b04263341de admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:37.024033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a43d51-96d8-40a2-b970-8b04263341de admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:37.028619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89180-b042-4408-9bae-3b26a37d2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:37.029206 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89180-b042-4408-9bae-3b26a37d2097 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:37.029479 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89180-b042-4408-9bae-3b26a37d2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:37.029748 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89180-b042-4408-9bae-3b26a37d2097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:37.030380 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89180-b042-4408-9bae-3b26a37d2097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:37.032306 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89180-b042-4408-9bae-3b26a37d2097 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:37.042908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1371/2758] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:37.047524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2fa05-236e-4a4b-a8c4-09e4450e8f1c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:37.059045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2fa05-236e-4a4b-a8c4-09e4450e8f1c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:37.066318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:37.066994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:37.067272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:37.067541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] PATH_INFO: `/v3/projects/232ec2039792487f8498240df82b2679/users/2df4ba57b0244ebbadc39d817eee22e4/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:37.083199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232ec2039792487f8498240df82b2679, user_id=2df4ba57b0244ebbadc39d817eee22e4, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:37.085853 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:37.099138 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1388/2759] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:37 2022] PUT /identity/v3/projects/232ec2039792487f8498240df82b2679/users/2df4ba57b0244ebbadc39d817eee22e4/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:37.112235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717e45d-30e4-4ddc-8b90-ff15658fa35d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:37.112789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717e45d-30e4-4ddc-8b90-ff15658fa35d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:37.112789 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717e45d-30e4-4ddc-8b90-ff15658fa35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:37.142616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-0717e45d-30e4-4ddc-8b90-ff15658fa35d None None] MFA Rules not processed for user `2df4ba57b0244ebbadc39d817eee22e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:37.143871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-0717e45d-30e4-4ddc-8b90-ff15658fa35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:37.209963 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1372/2760] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:37.221315 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:37.223038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:37.284377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587c9c4-1f3a-4f5a-8c3f-1262cdb599d6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:37.288134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753b968-7c28-42da-a775-47b1f0e3df69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:37.288735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b968-7c28-42da-a775-47b1f0e3df69 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:37.289014 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b968-7c28-42da-a775-47b1f0e3df69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:37.289287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b968-7c28-42da-a775-47b1f0e3df69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:37.297898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753b968-7c28-42da-a775-47b1f0e3df69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:37.299346 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753b968-7c28-42da-a775-47b1f0e3df69 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:37.308207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1389/2761] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:39.867954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717e45d-30e4-4ddc-8b90-ff15658fa35d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:39.928776 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717e45d-30e4-4ddc-8b90-ff15658fa35d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:39.933189 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:39.933805 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:39.934081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:39.934352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] PATH_INFO: `/v3/users/2df4ba57b0244ebbadc39d817eee22e4` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:39.935492 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df4ba57b0244ebbadc39d817eee22e4)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:39.937405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:39.980092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:39.987361 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df4ba57b0244ebbadc39d817eee22e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:39.995156 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df4ba57b0244ebbadc39d817eee22e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:39.995778 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df4ba57b0244ebbadc39d817eee22e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:39.996397 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df4ba57b0244ebbadc39d817eee22e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:40.004650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df4ba57b0244ebbadc39d817eee22e4'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:40.022427 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1373/2762] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:08:39 2022] DELETE /identity/v3/users/2df4ba57b0244ebbadc39d817eee22e4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:40.026875 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bec9a-9cfb-4fd9-b4ea-f241ecbb9703 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.027376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bec9a-9cfb-4fd9-b4ea-f241ecbb9703 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.027479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bec9a-9cfb-4fd9-b4ea-f241ecbb9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.046201 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e83bec9a-9cfb-4fd9-b4ea-f241ecbb9703 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:40.047429 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e83bec9a-9cfb-4fd9-b4ea-f241ecbb9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:40.078861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:40.110211 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1390/2763] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:08:40.120455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:40.122006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:40.179392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4321d-2430-429f-9106-b0e6ae583092 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:40.183026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e586bbc-3f6a-4c04-8a8e-420437b8d14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:40.183619 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e586bbc-3f6a-4c04-8a8e-420437b8d14e service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.183895 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e586bbc-3f6a-4c04-8a8e-420437b8d14e service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.184164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e586bbc-3f6a-4c04-8a8e-420437b8d14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.193610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e586bbc-3f6a-4c04-8a8e-420437b8d14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:40.195087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e586bbc-3f6a-4c04-8a8e-420437b8d14e service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:40.204456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1374/2764] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:40.470091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bec9a-9cfb-4fd9-b4ea-f241ecbb9703 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:40.471589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e83bec9a-9cfb-4fd9-b4ea-f241ecbb9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:40.483839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bec9a-9cfb-4fd9-b4ea-f241ecbb9703 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:40.488801 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:40.489577 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.489858 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.490132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] PATH_INFO: `/v3/projects/232ec2039792487f8498240df82b2679` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.491280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232ec2039792487f8498240df82b2679)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:40.493174 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:40.541100 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232ec2039792487f8498240df82b2679', 'request_id': 'req-199b8553-0ad6-42fe-b928-41613a94d1e3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:40.546638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232ec2039792487f8498240df82b2679', 'request_id': 'req-199b8553-0ad6-42fe-b928-41613a94d1e3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:40.554110 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232ec2039792487f8498240df82b2679', 'request_id': 'req-199b8553-0ad6-42fe-b928-41613a94d1e3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:40.566152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] The token cache is being invalidate because project 232ec2039792487f8498240df82b2679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:08:40.566440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:40.567124 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-199b8553-0ad6-42fe-b928-41613a94d1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:08:40.568599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1391/2765] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:08:40 2022] DELETE /identity/v3/projects/232ec2039792487f8498240df82b2679 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:08:40.573553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2928c-d216-424b-a4de-89eb11d0a983 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.573840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2928c-d216-424b-a4de-89eb11d0a983 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.574113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2928c-d216-424b-a4de-89eb11d0a983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.594104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b2a2928c-d216-424b-a4de-89eb11d0a983 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:40.595328 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b2a2928c-d216-424b-a4de-89eb11d0a983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:40.653842 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1375/2766] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:40.662343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7cc4-e5a3-4dbe-af63-67b585cd19c0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.662343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7cc4-e5a3-4dbe-af63-67b585cd19c0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.662343 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7cc4-e5a3-4dbe-af63-67b585cd19c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.681958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-76ce7cc4-e5a3-4dbe-af63-67b585cd19c0 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:40.683210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-76ce7cc4-e5a3-4dbe-af63-67b585cd19c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:40.691695 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1392/2767] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:40.696028 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2928c-d216-424b-a4de-89eb11d0a983 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:40.706368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2928c-d216-424b-a4de-89eb11d0a983 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:40.710902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:40.711488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.711764 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.712063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.712736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:08:40.713090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:40.714632 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:40.726255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1376/2768] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:08:40.730440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce7cc4-e5a3-4dbe-af63-67b585cd19c0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:40.739915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce7cc4-e5a3-4dbe-af63-67b585cd19c0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:40.744595 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c0ee-7e88-4534-9228-41ba56aa567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:40.745178 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c0ee-7e88-4534-9228-41ba56aa567b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.745453 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c0ee-7e88-4534-9228-41ba56aa567b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.745719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c0ee-7e88-4534-9228-41ba56aa567b admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.746350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c0ee-7e88-4534-9228-41ba56aa567b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:40.748285 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c0ee-7e88-4534-9228-41ba56aa567b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:40.776696 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1393/2769] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:08:40 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:40.780853 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:40.790994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9f5d6-6de0-4ae0-af0a-6d24ee0783f9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:40.836277 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:40.851691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec532375-b2a4-49a9-a6d6-ccdd6c432429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:40.852321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532375-b2a4-49a9-a6d6-ccdd6c432429 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.852607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532375-b2a4-49a9-a6d6-ccdd6c432429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.852872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532375-b2a4-49a9-a6d6-ccdd6c432429 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.853515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec532375-b2a4-49a9-a6d6-ccdd6c432429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:40.855537 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec532375-b2a4-49a9-a6d6-ccdd6c432429 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:40.878484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1377/2770] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:08:40 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:08:40.883455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c0ee-7e88-4534-9228-41ba56aa567b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:40.894625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c0ee-7e88-4534-9228-41ba56aa567b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:40.899347 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff696d-0202-4701-82b4-9b79e68f37a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:40.900015 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff696d-0202-4701-82b4-9b79e68f37a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.900362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff696d-0202-4701-82b4-9b79e68f37a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.900703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff696d-0202-4701-82b4-9b79e68f37a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.901445 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff696d-0202-4701-82b4-9b79e68f37a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:40.903135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff696d-0202-4701-82b4-9b79e68f37a3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:40.913591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1394/2771] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:40.917534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec532375-b2a4-49a9-a6d6-ccdd6c432429 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:40.928968 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec532375-b2a4-49a9-a6d6-ccdd6c432429 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:40.933923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf336f-b3f7-4ee6-9f6e-a6effb65b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:40.934682 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf336f-b3f7-4ee6-9f6e-a6effb65b355 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.935017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf336f-b3f7-4ee6-9f6e-a6effb65b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.935290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf336f-b3f7-4ee6-9f6e-a6effb65b355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.935942 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf336f-b3f7-4ee6-9f6e-a6effb65b355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:40.937637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf336f-b3f7-4ee6-9f6e-a6effb65b355 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:40.950247 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1378/2772] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:08:40.954645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff696d-0202-4701-82b4-9b79e68f37a3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:40.966685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff696d-0202-4701-82b4-9b79e68f37a3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:40.972504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:40.973182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:40.973459 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:40.973733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] PATH_INFO: `/v3/projects/0ee3fe5ded1d46e7945aa6e9fd9cdd12/users/e82e6544015043119a78426689c3199a/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:40.990612 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee3fe5ded1d46e7945aa6e9fd9cdd12, user_id=e82e6544015043119a78426689c3199a, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:40.993360 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:41.008477 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1395/2773] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:08:40 2022] PUT /identity/v3/projects/0ee3fe5ded1d46e7945aa6e9fd9cdd12/users/e82e6544015043119a78426689c3199a/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:08:41.013692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d43ea-01fa-4b76-8c4f-ff53a01966a3 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:41.014060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d43ea-01fa-4b76-8c4f-ff53a01966a3 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:41.014437 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d43ea-01fa-4b76-8c4f-ff53a01966a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:41.034287 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-820d43ea-01fa-4b76-8c4f-ff53a01966a3 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:41.035680 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-820d43ea-01fa-4b76-8c4f-ff53a01966a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:41.100034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1379/2774] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:41.110703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:41.113704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:41.211950 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e7cc-6f82-475e-8e35-dadf5d235c44 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:41.215687 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:41.216471 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:41.216684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:41.217011 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:41.225845 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:41.229653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:41.231839 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:41.255064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1396/2775] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:41.945760 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c892-1fb3-42c7-ab32-d4d7c4522980 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:41.946308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c892-1fb3-42c7-ab32-d4d7c4522980 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:41.946308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c892-1fb3-42c7-ab32-d4d7c4522980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:41.975768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-68f3c892-1fb3-42c7-ab32-d4d7c4522980 None None] MFA Rules not processed for user `e82e6544015043119a78426689c3199a`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:41.976966 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-68f3c892-1fb3-42c7-ab32-d4d7c4522980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:42.048153 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1380/2776] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:42.059494 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:08:42.060868 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:42.120388 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5cff0-975d-4007-8602-dbf08614e803 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:08:42.124132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:08:42.124805 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:42.125087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:42.125358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:42.134290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:08:42.135743 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:08:42.145209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1397/2777] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:08:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:08:43.573703 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafdeb-6d42-4502-8e7b-4da4e86cdeb0 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:08:43.574165 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafdeb-6d42-4502-8e7b-4da4e86cdeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:08:43.574267 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafdeb-6d42-4502-8e7b-4da4e86cdeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:08:43.596026 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-35cafdeb-6d42-4502-8e7b-4da4e86cdeb0 None None] MFA Rules not processed for user `e82e6544015043119a78426689c3199a`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:08:43.597646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-35cafdeb-6d42-4502-8e7b-4da4e86cdeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:08:43.604694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1381/2778] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:08:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:08:52.140828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=28 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:53.591194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:04.258417 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:04.259930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:04.399312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee01f2b-051d-4489-8773-1374a2f2a117 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:04.404321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:04.404907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:04.405177 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:04.405442 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:04.407125 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:04.418295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:04.419909 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:04.432039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1398/2779] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:07.480854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1a04-6acc-4606-8365-a4a1d4e40f42 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:07.481411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1a04-6acc-4606-8365-a4a1d4e40f42 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:07.481411 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1a04-6acc-4606-8365-a4a1d4e40f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:07.549732 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-b1cb1a04-6acc-4606-8365-a4a1d4e40f42 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:07.550945 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b1cb1a04-6acc-4606-8365-a4a1d4e40f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:07.578549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1382/2780] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:07.595333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:07.596779 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:07.682313 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:07.698247 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397ebf5-4992-4670-bd02-46cb6b2c9987 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:07.703606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:07.704191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:07.704463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:07.704728 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:07.713183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:07.714719 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:07.724519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1399/2781] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:10.509444 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c101aa4-3b7e-4ca7-9c08-77a84aa33fbc None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:10.509996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c101aa4-3b7e-4ca7-9c08-77a84aa33fbc None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:10.509996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c101aa4-3b7e-4ca7-9c08-77a84aa33fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:10.529763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5c101aa4-3b7e-4ca7-9c08-77a84aa33fbc None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:10.530984 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5c101aa4-3b7e-4ca7-9c08-77a84aa33fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:10.539076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1383/2782] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:10.553036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:10.554450 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:10.570106 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e90ba-55c9-4e04-bccc-dd6ea0c61056 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:10.575606 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68dd0-4f3d-4edb-bd47-cbe5c63e51fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:10.576191 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68dd0-4f3d-4edb-bd47-cbe5c63e51fc service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:10.576472 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68dd0-4f3d-4edb-bd47-cbe5c63e51fc service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:10.576744 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68dd0-4f3d-4edb-bd47-cbe5c63e51fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:10.585375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68dd0-4f3d-4edb-bd47-cbe5c63e51fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:10.586956 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68dd0-4f3d-4edb-bd47-cbe5c63e51fc service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:10.596468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1400/2783] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:13.795660 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333046-071e-44f8-932d-d8cbba4e0dfd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:13.796302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333046-071e-44f8-932d-d8cbba4e0dfd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:13.796302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333046-071e-44f8-932d-d8cbba4e0dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:13.815681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-42333046-071e-44f8-932d-d8cbba4e0dfd None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:13.816872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-42333046-071e-44f8-932d-d8cbba4e0dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:13.824755 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1384/2784] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:13.839045 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68dd0-4f3d-4edb-bd47-cbe5c63e51fc service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:13.850944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68dd0-4f3d-4edb-bd47-cbe5c63e51fc service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:13.856237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddd57d-c200-4b3a-8081-fa35f731679c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:13.856830 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd57d-c200-4b3a-8081-fa35f731679c service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:13.857102 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd57d-c200-4b3a-8081-fa35f731679c service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:13.857367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd57d-c200-4b3a-8081-fa35f731679c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:13.865320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddd57d-c200-4b3a-8081-fa35f731679c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:13.866892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddd57d-c200-4b3a-8081-fa35f731679c service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:13.876038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1401/2785] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:16.866542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621180-fdec-4b5b-95f3-f6b43f5fa016 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:16.867058 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621180-fdec-4b5b-95f3-f6b43f5fa016 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:16.867172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621180-fdec-4b5b-95f3-f6b43f5fa016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:16.886852 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-e5621180-fdec-4b5b-95f3-f6b43f5fa016 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:16.888029 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-e5621180-fdec-4b5b-95f3-f6b43f5fa016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:16.896041 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1385/2786] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:16.911548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddd57d-c200-4b3a-8081-fa35f731679c service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:16.922887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddd57d-c200-4b3a-8081-fa35f731679c service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:16.929122 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b8bec-39c3-408e-9d80-3eda422b0d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:16.929738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b8bec-39c3-408e-9d80-3eda422b0d00 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:16.930013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b8bec-39c3-408e-9d80-3eda422b0d00 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:16.930280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b8bec-39c3-408e-9d80-3eda422b0d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:16.938515 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b8bec-39c3-408e-9d80-3eda422b0d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:16.940098 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b8bec-39c3-408e-9d80-3eda422b0d00 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:16.949475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1402/2787] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:20.045561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9411f8-fb76-45c0-bf77-9c6c7c9ed996 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:20.046068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9411f8-fb76-45c0-bf77-9c6c7c9ed996 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:20.046184 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9411f8-fb76-45c0-bf77-9c6c7c9ed996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:20.065179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5e9411f8-fb76-45c0-bf77-9c6c7c9ed996 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:20.066372 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5e9411f8-fb76-45c0-bf77-9c6c7c9ed996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:20.074426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1386/2788] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:20.091375 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b8bec-39c3-408e-9d80-3eda422b0d00 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:20.103435 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b8bec-39c3-408e-9d80-3eda422b0d00 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:20.108898 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa850b7-e934-42b4-b5e8-ed74e3a9303b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:20.109480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa850b7-e934-42b4-b5e8-ed74e3a9303b service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:20.109790 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa850b7-e934-42b4-b5e8-ed74e3a9303b service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:20.110061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa850b7-e934-42b4-b5e8-ed74e3a9303b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:20.118265 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa850b7-e934-42b4-b5e8-ed74e3a9303b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:20.119833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa850b7-e934-42b4-b5e8-ed74e3a9303b service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:20.128905 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1403/2789] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:23.206914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5bc1f-8068-434a-8153-4ab39baecb4e None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:23.206914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5bc1f-8068-434a-8153-4ab39baecb4e None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:23.206914 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5bc1f-8068-434a-8153-4ab39baecb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:23.230360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-7ea5bc1f-8068-434a-8153-4ab39baecb4e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:23.231683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7ea5bc1f-8068-434a-8153-4ab39baecb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:23.240924 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1387/2790] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:23.256374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa850b7-e934-42b4-b5e8-ed74e3a9303b service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:23.267614 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa850b7-e934-42b4-b5e8-ed74e3a9303b service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:23.273976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb539df-285b-41a9-a04f-c36ffb3949a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:23.274571 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb539df-285b-41a9-a04f-c36ffb3949a3 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:23.274876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb539df-285b-41a9-a04f-c36ffb3949a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:23.275150 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb539df-285b-41a9-a04f-c36ffb3949a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:23.284271 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb539df-285b-41a9-a04f-c36ffb3949a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:23.285855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb539df-285b-41a9-a04f-c36ffb3949a3 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:23.296886 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1404/2791] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:33.222466 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=45 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:33.292121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=39 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:36.419172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bcb6-70bd-442f-9f9f-accbd8eb447f None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:36.419704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bcb6-70bd-442f-9f9f-accbd8eb447f None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:36.419704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bcb6-70bd-442f-9f9f-accbd8eb447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:36.440211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cf87bcb6-70bd-442f-9f9f-accbd8eb447f None None] MFA Rules not processed for user `6448ed94c69a467ca4128fb82c2b08de`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:36.441338 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cf87bcb6-70bd-442f-9f9f-accbd8eb447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:36.495499 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1388/2792] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:09:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:38.441404 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c1fd-e6b1-48c5-886e-8308418723cb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:38.441946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c1fd-e6b1-48c5-886e-8308418723cb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:38.441946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c1fd-e6b1-48c5-886e-8308418723cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:38.461249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-92f1c1fd-e6b1-48c5-886e-8308418723cb None None] MFA Rules not processed for user `e82e6544015043119a78426689c3199a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:38.462475 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-92f1c1fd-e6b1-48c5-886e-8308418723cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:38.469510 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1405/2793] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:09:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:38.815616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87bcb6-70bd-442f-9f9f-accbd8eb447f None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:38.817112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cf87bcb6-70bd-442f-9f9f-accbd8eb447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:38.853722 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87bcb6-70bd-442f-9f9f-accbd8eb447f None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:38.857302 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:38.857899 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:38.858173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:38.858441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:38.860193 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:38.870366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:38.872071 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:38.881005 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1389/2794] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:48.455653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:48.876373 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=40 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:51.791753 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23489c3-1c57-4ba4-8058-45f22e158cc6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:51.792333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23489c3-1c57-4ba4-8058-45f22e158cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:51.792333 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23489c3-1c57-4ba4-8058-45f22e158cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:51.811611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d23489c3-1c57-4ba4-8058-45f22e158cc6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:51.812838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d23489c3-1c57-4ba4-8058-45f22e158cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:51.821548 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1406/2795] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:51.836540 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:51.851305 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156da400-92e1-468f-9a69-0827a2b2833d service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:51.856783 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500df02-a79e-4c69-80c8-1afc7b56b617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:51.857370 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500df02-a79e-4c69-80c8-1afc7b56b617 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:51.857647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500df02-a79e-4c69-80c8-1afc7b56b617 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:51.857915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500df02-a79e-4c69-80c8-1afc7b56b617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:51.866702 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500df02-a79e-4c69-80c8-1afc7b56b617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:51.868238 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500df02-a79e-4c69-80c8-1afc7b56b617 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:51.877757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1390/2796] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:55.042046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaa699-eea9-43a6-8435-22503f451992 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:55.042650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaa699-eea9-43a6-8435-22503f451992 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:55.042650 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaa699-eea9-43a6-8435-22503f451992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:55.062777 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9ffaa699-eea9-43a6-8435-22503f451992 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:55.063978 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9ffaa699-eea9-43a6-8435-22503f451992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:55.072500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1407/2797] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:55.086455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500df02-a79e-4c69-80c8-1afc7b56b617 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:55.097366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500df02-a79e-4c69-80c8-1afc7b56b617 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:55.102857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84489-396d-4bfe-a13d-2d56d09b5d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:55.103430 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84489-396d-4bfe-a13d-2d56d09b5d81 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:55.103704 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84489-396d-4bfe-a13d-2d56d09b5d81 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:55.104001 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84489-396d-4bfe-a13d-2d56d09b5d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:55.111862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd84489-396d-4bfe-a13d-2d56d09b5d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:55.113414 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd84489-396d-4bfe-a13d-2d56d09b5d81 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:55.123210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1391/2798] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:09:58.133626 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f4f1-28cb-435c-b28a-161274c79636 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:58.134153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f4f1-28cb-435c-b28a-161274c79636 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:58.134153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f4f1-28cb-435c-b28a-161274c79636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:58.157598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1f60f4f1-28cb-435c-b28a-161274c79636 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:09:58.158836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1f60f4f1-28cb-435c-b28a-161274c79636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:09:58.167001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1408/2799] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:09:58.182290 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84489-396d-4bfe-a13d-2d56d09b5d81 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:09:58.193214 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84489-396d-4bfe-a13d-2d56d09b5d81 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:09:58.199542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183d9b3-bfcb-4528-8d19-9333da78482d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:09:58.200119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183d9b3-bfcb-4528-8d19-9333da78482d service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:09:58.200392 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183d9b3-bfcb-4528-8d19-9333da78482d service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:09:58.200657 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183d9b3-bfcb-4528-8d19-9333da78482d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:09:58.208490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183d9b3-bfcb-4528-8d19-9333da78482d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:09:58.210085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183d9b3-bfcb-4528-8d19-9333da78482d service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:09:58.219538 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1392/2800] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:01.291458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76de51-2bb3-473c-9990-9f3ff62b0cbc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:01.291953 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76de51-2bb3-473c-9990-9f3ff62b0cbc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:01.292066 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76de51-2bb3-473c-9990-9f3ff62b0cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:01.313402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6a76de51-2bb3-473c-9990-9f3ff62b0cbc None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:01.314617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6a76de51-2bb3-473c-9990-9f3ff62b0cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:01.322651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1409/2801] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:01.339692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183d9b3-bfcb-4528-8d19-9333da78482d service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:01.352297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183d9b3-bfcb-4528-8d19-9333da78482d service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:01.358211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8eea1-37bd-4d5a-a9fd-e288b74be543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:01.358884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8eea1-37bd-4d5a-a9fd-e288b74be543 service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:01.359162 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8eea1-37bd-4d5a-a9fd-e288b74be543 service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:01.359459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8eea1-37bd-4d5a-a9fd-e288b74be543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:01.368885 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8eea1-37bd-4d5a-a9fd-e288b74be543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:01.370459 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8eea1-37bd-4d5a-a9fd-e288b74be543 service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:01.382593 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1393/2802] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:04.462708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fcb77-f81d-4900-95b6-c84c051e7e88 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:04.463230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fcb77-f81d-4900-95b6-c84c051e7e88 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:04.463437 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fcb77-f81d-4900-95b6-c84c051e7e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:04.483238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6d8fcb77-f81d-4900-95b6-c84c051e7e88 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:04.484524 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6d8fcb77-f81d-4900-95b6-c84c051e7e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:04.493083 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1410/2803] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 24 05:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:10:04.510324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8eea1-37bd-4d5a-a9fd-e288b74be543 service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:04.522520 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8eea1-37bd-4d5a-a9fd-e288b74be543 service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:04.528608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9433-f686-44aa-ba70-c25b3482fa0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:04.529185 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9433-f686-44aa-ba70-c25b3482fa0f service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:04.529456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9433-f686-44aa-ba70-c25b3482fa0f service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:04.529720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9433-f686-44aa-ba70-c25b3482fa0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:04.537584 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b9433-f686-44aa-ba70-c25b3482fa0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:04.539171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b9433-f686-44aa-ba70-c25b3482fa0f service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:04.548482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1394/2804] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:14.477089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=15 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:14.544345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=30 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:32.550973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fcb77-f81d-4900-95b6-c84c051e7e88 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:32.564203 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fcb77-f81d-4900-95b6-c84c051e7e88 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:32.570012 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:32.570806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:32.571105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:32.571371 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] PATH_INFO: `/v3/users/e82e6544015043119a78426689c3199a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:32.572674 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82e6544015043119a78426689c3199a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:32.575455 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:32.624491 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82e6544015043119a78426689c3199a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:32.632635 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82e6544015043119a78426689c3199a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:32.633430 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82e6544015043119a78426689c3199a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:32.634090 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82e6544015043119a78426689c3199a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:32.641390 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82e6544015043119a78426689c3199a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:32.665000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1411/2805] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:10:32 2022] DELETE /identity/v3/users/e82e6544015043119a78426689c3199a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:10:32.846478 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9433-f686-44aa-ba70-c25b3482fa0f service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:32.857936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9433-f686-44aa-ba70-c25b3482fa0f service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:32.931027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:32.931870 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:32.932576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:32.932995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] PATH_INFO: `/v3/projects/0ee3fe5ded1d46e7945aa6e9fd9cdd12` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:32.934308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee3fe5ded1d46e7945aa6e9fd9cdd12)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:32.936222 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:32.991743 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee3fe5ded1d46e7945aa6e9fd9cdd12', 'request_id': 'req-c23424b7-3ab4-416b-bff3-4d70851ebe8f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:32.998043 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee3fe5ded1d46e7945aa6e9fd9cdd12', 'request_id': 'req-c23424b7-3ab4-416b-bff3-4d70851ebe8f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:33.005937 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee3fe5ded1d46e7945aa6e9fd9cdd12', 'request_id': 'req-c23424b7-3ab4-416b-bff3-4d70851ebe8f'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:33.018498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] The token cache is being invalidate because project 0ee3fe5ded1d46e7945aa6e9fd9cdd12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:10:33.018811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:33.019456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:33.021175 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1395/2806] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:10:32 2022] DELETE /identity/v3/projects/0ee3fe5ded1d46e7945aa6e9fd9cdd12 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:39.688281 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:39.689810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:39.703662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a835647-2ac3-4537-9969-0a4d8e118865 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:39.768069 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:39.768710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:39.768988 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:39.769318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] PATH_INFO: `/v3/users/6448ed94c69a467ca4128fb82c2b08de` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:39.770770 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6448ed94c69a467ca4128fb82c2b08de)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:39.772704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:39.829284 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6448ed94c69a467ca4128fb82c2b08de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:39.836644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6448ed94c69a467ca4128fb82c2b08de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:39.837264 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6448ed94c69a467ca4128fb82c2b08de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:39.837874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6448ed94c69a467ca4128fb82c2b08de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:39.845013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0af8f25-5a38-40b4-880d-979cd87b18dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6448ed94c69a467ca4128fb82c2b08de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:39.852697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:39.866063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1412/2807] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:10:39 2022] DELETE /identity/v3/users/6448ed94c69a467ca4128fb82c2b08de => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:40.036456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.037864 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:40.052857 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23424b7-3ab4-416b-bff3-4d70851ebe8f admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.110999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.111654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.111932 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.112204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] PATH_INFO: `/v3/projects/dd613ed3a4174659b2f1fc5242ebff5c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.113322 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd613ed3a4174659b2f1fc5242ebff5c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.115269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.149977 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:40.163337 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd613ed3a4174659b2f1fc5242ebff5c', 'request_id': 'req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:40.169010 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd613ed3a4174659b2f1fc5242ebff5c', 'request_id': 'req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:40.176166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd613ed3a4174659b2f1fc5242ebff5c', 'request_id': 'req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:40.188080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] The token cache is being invalidate because project dd613ed3a4174659b2f1fc5242ebff5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:10:40.188359 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:40.188985 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17cebb6d-01d4-4d22-b4f7-764838a2c2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:40.190449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1396/2808] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:10:40 2022] DELETE /identity/v3/projects/dd613ed3a4174659b2f1fc5242ebff5c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:40.195394 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7fc5-7497-405f-a6e9-703727acc20e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.195682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7fc5-7497-405f-a6e9-703727acc20e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.195959 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7fc5-7497-405f-a6e9-703727acc20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.216765 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6dce7fc5-7497-405f-a6e9-703727acc20e None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:40.217902 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6dce7fc5-7497-405f-a6e9-703727acc20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:40.275807 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1413/2809] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:40.284112 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813dca-4415-4594-ae24-4f074a839222 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.284391 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813dca-4415-4594-ae24-4f074a839222 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.284662 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813dca-4415-4594-ae24-4f074a839222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.304352 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-9e813dca-4415-4594-ae24-4f074a839222 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:40.305547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9e813dca-4415-4594-ae24-4f074a839222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:40.313978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1397/2810] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:40.318207 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce7fc5-7497-405f-a6e9-703727acc20e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.328925 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce7fc5-7497-405f-a6e9-703727acc20e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.333432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.334021 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.334295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.334560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.335228 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:10:40.335528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.337093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.348842 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1414/2811] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:10:40.353033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e813dca-4415-4594-ae24-4f074a839222 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.362856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e813dca-4415-4594-ae24-4f074a839222 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.367449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0958ae-05ab-42a6-8856-ceec59ac41d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.368033 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0958ae-05ab-42a6-8856-ceec59ac41d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.368307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0958ae-05ab-42a6-8856-ceec59ac41d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.368577 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0958ae-05ab-42a6-8856-ceec59ac41d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.369199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0958ae-05ab-42a6-8856-ceec59ac41d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.371863 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0958ae-05ab-42a6-8856-ceec59ac41d1 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.398603 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1398/2812] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:10:40 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:40.402897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.413061 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524849-859e-44d9-99c4-c8a92c569c27 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.468483 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96230ad9-8b5d-49f7-8fa3-161fe8bedc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.468995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230ad9-8b5d-49f7-8fa3-161fe8bedc5a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.469267 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230ad9-8b5d-49f7-8fa3-161fe8bedc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.469533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230ad9-8b5d-49f7-8fa3-161fe8bedc5a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.470149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96230ad9-8b5d-49f7-8fa3-161fe8bedc5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.472063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96230ad9-8b5d-49f7-8fa3-161fe8bedc5a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.492703 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1415/2813] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:10:40 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:10:40.497440 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0958ae-05ab-42a6-8856-ceec59ac41d1 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.507549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0958ae-05ab-42a6-8856-ceec59ac41d1 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.512096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667b584-8773-4d09-aa36-acdf0c600cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.512679 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b584-8773-4d09-aa36-acdf0c600cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.512961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b584-8773-4d09-aa36-acdf0c600cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.513230 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b584-8773-4d09-aa36-acdf0c600cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.513873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667b584-8773-4d09-aa36-acdf0c600cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.515484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667b584-8773-4d09-aa36-acdf0c600cf5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.525455 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1399/2814] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:10:40.529268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96230ad9-8b5d-49f7-8fa3-161fe8bedc5a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.538991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96230ad9-8b5d-49f7-8fa3-161fe8bedc5a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.544171 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79243b-6862-4b57-975c-6ec065675a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.544751 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79243b-6862-4b57-975c-6ec065675a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.545025 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79243b-6862-4b57-975c-6ec065675a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.545293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79243b-6862-4b57-975c-6ec065675a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.545921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79243b-6862-4b57-975c-6ec065675a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.547525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79243b-6862-4b57-975c-6ec065675a30 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.558824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1416/2815] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:40.562820 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667b584-8773-4d09-aa36-acdf0c600cf5 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.572674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667b584-8773-4d09-aa36-acdf0c600cf5 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.577323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61265e-978e-4f6b-b735-7c7ca7331a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.577986 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61265e-978e-4f6b-b735-7c7ca7331a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.578265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61265e-978e-4f6b-b735-7c7ca7331a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.578542 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61265e-978e-4f6b-b735-7c7ca7331a69 admin admin] PATH_INFO: `/v3/projects/9583559169534c2480bb5d7e13cfaaec/users/935fcd9b0d6842379b3fb663353a1725/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.593921 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61265e-978e-4f6b-b735-7c7ca7331a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9583559169534c2480bb5d7e13cfaaec, user_id=935fcd9b0d6842379b3fb663353a1725, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.596698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61265e-978e-4f6b-b735-7c7ca7331a69 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.610598 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1400/2816] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:40 2022] PUT /identity/v3/projects/9583559169534c2480bb5d7e13cfaaec/users/935fcd9b0d6842379b3fb663353a1725/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:40.621359 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc027c0f-be89-4fa2-81d2-331dc5d13ead None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.621642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc027c0f-be89-4fa2-81d2-331dc5d13ead None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.621915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc027c0f-be89-4fa2-81d2-331dc5d13ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.650855 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bc027c0f-be89-4fa2-81d2-331dc5d13ead None None] MFA Rules not processed for user `935fcd9b0d6842379b3fb663353a1725`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:40.652465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bc027c0f-be89-4fa2-81d2-331dc5d13ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:40.698005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:40.722052 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1417/2817] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:10:40.726737 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61265e-978e-4f6b-b735-7c7ca7331a69 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.788521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61265e-978e-4f6b-b735-7c7ca7331a69 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.793906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ada3e-18cc-40b0-8817-b813a1952109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.794496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ada3e-18cc-40b0-8817-b813a1952109 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.794790 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ada3e-18cc-40b0-8817-b813a1952109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.795063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ada3e-18cc-40b0-8817-b813a1952109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.795694 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ada3e-18cc-40b0-8817-b813a1952109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.797629 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ada3e-18cc-40b0-8817-b813a1952109 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.824640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1401/2818] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:10:40 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:40.828906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc027c0f-be89-4fa2-81d2-331dc5d13ead None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.840065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc027c0f-be89-4fa2-81d2-331dc5d13ead None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.895276 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac1a2a-8b37-4377-b536-01875eccaec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.896119 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac1a2a-8b37-4377-b536-01875eccaec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.896391 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac1a2a-8b37-4377-b536-01875eccaec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.896651 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac1a2a-8b37-4377-b536-01875eccaec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.897268 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac1a2a-8b37-4377-b536-01875eccaec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.899202 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac1a2a-8b37-4377-b536-01875eccaec3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.920089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1418/2819] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:10:40 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:40.924255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ada3e-18cc-40b0-8817-b813a1952109 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.935425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ada3e-18cc-40b0-8817-b813a1952109 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.940107 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700299c8-e207-4bcb-a535-7c86141a3146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.940695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700299c8-e207-4bcb-a535-7c86141a3146 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.940965 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700299c8-e207-4bcb-a535-7c86141a3146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.941345 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700299c8-e207-4bcb-a535-7c86141a3146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.941982 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700299c8-e207-4bcb-a535-7c86141a3146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.943610 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700299c8-e207-4bcb-a535-7c86141a3146 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:40.955090 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1402/2820] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:40.959287 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac1a2a-8b37-4377-b536-01875eccaec3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:40.969123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac1a2a-8b37-4377-b536-01875eccaec3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:40.973846 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1480b-f9a5-4882-95d6-975c0d156e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:40.974424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1480b-f9a5-4882-95d6-975c0d156e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:40.974720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1480b-f9a5-4882-95d6-975c0d156e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:40.975016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1480b-f9a5-4882-95d6-975c0d156e32 admin admin] PATH_INFO: `/v3/projects/17913537fad046179f256b736784f8df/users/e19b04c5e55347caaf677e6fa119d47e/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:40.991121 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1480b-f9a5-4882-95d6-975c0d156e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17913537fad046179f256b736784f8df, user_id=e19b04c5e55347caaf677e6fa119d47e, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:40.993859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1480b-f9a5-4882-95d6-975c0d156e32 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:41.006892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1419/2821] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:40 2022] PUT /identity/v3/projects/17913537fad046179f256b736784f8df/users/e19b04c5e55347caaf677e6fa119d47e/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:10:41.011067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700299c8-e207-4bcb-a535-7c86141a3146 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:41.021261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700299c8-e207-4bcb-a535-7c86141a3146 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:41.049699 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:41.079105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd3268-7a3f-4634-b18a-b174d469e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:41.079701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3268-7a3f-4634-b18a-b174d469e46c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:41.079976 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3268-7a3f-4634-b18a-b174d469e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:41.080243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3268-7a3f-4634-b18a-b174d469e46c admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:41.080873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd3268-7a3f-4634-b18a-b174d469e46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:41.082602 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd3268-7a3f-4634-b18a-b174d469e46c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:41.092244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1403/2822] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:41.096767 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1480b-f9a5-4882-95d6-975c0d156e32 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:41.107866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1480b-f9a5-4882-95d6-975c0d156e32 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:41.112390 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:41.113018 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:41.113293 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:41.113556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] PATH_INFO: `/v3/projects/17913537fad046179f256b736784f8df/users/e19b04c5e55347caaf677e6fa119d47e/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:41.115518 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17913537fad046179f256b736784f8df, user_id=e19b04c5e55347caaf677e6fa119d47e, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:41.118101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:41.128599 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1420/2823] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:41 2022] PUT /identity/v3/projects/17913537fad046179f256b736784f8df/users/e19b04c5e55347caaf677e6fa119d47e/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:41.139861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9e38a-f4be-4018-acf6-9b51d428484d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:41.140145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9e38a-f4be-4018-acf6-9b51d428484d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:41.140426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9e38a-f4be-4018-acf6-9b51d428484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:41.168118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-dff9e38a-f4be-4018-acf6-9b51d428484d None None] MFA Rules not processed for user `e19b04c5e55347caaf677e6fa119d47e`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:41.169326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-dff9e38a-f4be-4018-acf6-9b51d428484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:41.238600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1404/2824] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:41.250480 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:41.252321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:41.330209 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c970-12be-49ee-a4f3-8ca363d1dc3e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:41.333812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a1d76-2d78-45af-951e-6253155f65f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:41.334396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1d76-2d78-45af-951e-6253155f65f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:41.334671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1d76-2d78-45af-951e-6253155f65f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:41.334969 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1d76-2d78-45af-951e-6253155f65f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:41.344574 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a1d76-2d78-45af-951e-6253155f65f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:41.346001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a1d76-2d78-45af-951e-6253155f65f3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:41.355866 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1421/2825] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:41.738031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9e38a-f4be-4018-acf6-9b51d428484d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:41.799348 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9e38a-f4be-4018-acf6-9b51d428484d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:41.803841 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:41.804453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:41.804729 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:41.804995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] PATH_INFO: `/v3/users/935fcd9b0d6842379b3fb663353a1725` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:41.806098 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] RBAC: Authorizing `identity:delete_user(user_id=935fcd9b0d6842379b3fb663353a1725)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:41.808147 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:41.854027 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935fcd9b0d6842379b3fb663353a1725'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:41.861142 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935fcd9b0d6842379b3fb663353a1725'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:41.861750 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935fcd9b0d6842379b3fb663353a1725'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:41.862339 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935fcd9b0d6842379b3fb663353a1725'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:41.863524 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:41.871199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935fcd9b0d6842379b3fb663353a1725'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:41.889275 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1405/2826] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:10:41 2022] DELETE /identity/v3/users/935fcd9b0d6842379b3fb663353a1725 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:41.893972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5bab3-c99b-4ee2-89e0-2cf2d64bde17 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:41.894460 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5bab3-c99b-4ee2-89e0-2cf2d64bde17 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:41.894559 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5bab3-c99b-4ee2-89e0-2cf2d64bde17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:41.913860 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fda5bab3-c99b-4ee2-89e0-2cf2d64bde17 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:41.915078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fda5bab3-c99b-4ee2-89e0-2cf2d64bde17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:41.931691 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:41.976597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1422/2827] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:41.987326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:41.988730 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:42.047218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3b1e-bd1b-42db-b013-371a4cfb456b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:42.050938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc939-4e78-4478-99f8-cab9f8360f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:42.051530 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc939-4e78-4478-99f8-cab9f8360f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:42.051741 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc939-4e78-4478-99f8-cab9f8360f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:42.052008 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc939-4e78-4478-99f8-cab9f8360f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:42.061586 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc939-4e78-4478-99f8-cab9f8360f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:42.063065 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc939-4e78-4478-99f8-cab9f8360f8c service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:42.072297 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1406/2828] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:42.349568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5bab3-c99b-4ee2-89e0-2cf2d64bde17 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:42.351063 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fda5bab3-c99b-4ee2-89e0-2cf2d64bde17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:42.363776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5bab3-c99b-4ee2-89e0-2cf2d64bde17 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:42.368476 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:42.369199 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:42.369546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:42.369892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] PATH_INFO: `/v3/projects/9583559169534c2480bb5d7e13cfaaec` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:42.371168 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9583559169534c2480bb5d7e13cfaaec)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:42.373210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:42.423345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9583559169534c2480bb5d7e13cfaaec', 'request_id': 'req-00c6939c-05bd-404b-97f7-837f9b1eec2a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.429183 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9583559169534c2480bb5d7e13cfaaec', 'request_id': 'req-00c6939c-05bd-404b-97f7-837f9b1eec2a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.435935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9583559169534c2480bb5d7e13cfaaec', 'request_id': 'req-00c6939c-05bd-404b-97f7-837f9b1eec2a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.447269 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] The token cache is being invalidate because project 9583559169534c2480bb5d7e13cfaaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:10:42.447550 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.448835 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.450307 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1423/2829] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:10:42 2022] DELETE /identity/v3/projects/9583559169534c2480bb5d7e13cfaaec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:42.454553 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc939-4e78-4478-99f8-cab9f8360f8c service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:42.464835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc939-4e78-4478-99f8-cab9f8360f8c service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:42.521762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:42.522378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:42.522650 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:42.522947 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] PATH_INFO: `/v3/users/e19b04c5e55347caaf677e6fa119d47e` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:42.524048 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19b04c5e55347caaf677e6fa119d47e)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:42.525955 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:42.570069 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19b04c5e55347caaf677e6fa119d47e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.577972 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19b04c5e55347caaf677e6fa119d47e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.578580 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19b04c5e55347caaf677e6fa119d47e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.579219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19b04c5e55347caaf677e6fa119d47e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.586148 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-5c0dd33d-97cf-497d-85da-8a18767c31ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19b04c5e55347caaf677e6fa119d47e'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:42.596608 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:42.605235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1407/2830] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:10:42 2022] DELETE /identity/v3/users/e19b04c5e55347caaf677e6fa119d47e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:42.868625 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:42.870078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:42.892465 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6939c-05bd-404b-97f7-837f9b1eec2a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:42.948157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:42.948864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:42.949764 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:42.950173 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] PATH_INFO: `/v3/projects/17913537fad046179f256b736784f8df` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:42.951317 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17913537fad046179f256b736784f8df)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:42.953197 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:42.997105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:42.998434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17913537fad046179f256b736784f8df', 'request_id': 'req-910474ba-061d-4131-baa0-4021f5533856'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:43.004907 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17913537fad046179f256b736784f8df', 'request_id': 'req-910474ba-061d-4131-baa0-4021f5533856'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:43.012873 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17913537fad046179f256b736784f8df', 'request_id': 'req-910474ba-061d-4131-baa0-4021f5533856'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:43.023996 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] The token cache is being invalidate because project 17913537fad046179f256b736784f8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:10:43.024277 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:43.024888 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-910474ba-061d-4131-baa0-4021f5533856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:43.026358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1424/2831] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:10:42 2022] DELETE /identity/v3/projects/17913537fad046179f256b736784f8df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:43.031344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3464a-9b7d-4c50-ac2e-6241af5463b8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.031633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3464a-9b7d-4c50-ac2e-6241af5463b8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.031906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3464a-9b7d-4c50-ac2e-6241af5463b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.051205 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-01c3464a-9b7d-4c50-ac2e-6241af5463b8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:43.052401 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-01c3464a-9b7d-4c50-ac2e-6241af5463b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:43.111326 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1408/2832] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:43.119154 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624d5a2-507e-4875-9e4d-7fd973790a3b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.119377 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624d5a2-507e-4875-9e4d-7fd973790a3b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.119645 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624d5a2-507e-4875-9e4d-7fd973790a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.140055 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4624d5a2-507e-4875-9e4d-7fd973790a3b None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:43.141249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4624d5a2-507e-4875-9e4d-7fd973790a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:43.149297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1425/2833] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:43.153681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3464a-9b7d-4c50-ac2e-6241af5463b8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.163319 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3464a-9b7d-4c50-ac2e-6241af5463b8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.168327 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.168906 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.169178 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.169445 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.170079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:10:43.170378 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.172003 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.183869 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1409/2834] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:10:43.188298 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624d5a2-507e-4875-9e4d-7fd973790a3b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.197440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624d5a2-507e-4875-9e4d-7fd973790a3b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.202463 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632301eb-e0f2-479e-a415-feea66e82891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.203093 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632301eb-e0f2-479e-a415-feea66e82891 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.203367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632301eb-e0f2-479e-a415-feea66e82891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.203636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632301eb-e0f2-479e-a415-feea66e82891 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.204290 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632301eb-e0f2-479e-a415-feea66e82891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.206176 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632301eb-e0f2-479e-a415-feea66e82891 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.233567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1426/2835] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:10:43 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:43.237035 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.247368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c960-b17b-46dd-8aa6-1e8248b1aeb6 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.302309 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea704d-573f-4876-80f5-5f4eedec50a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.302934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea704d-573f-4876-80f5-5f4eedec50a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.303213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea704d-573f-4876-80f5-5f4eedec50a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.303489 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea704d-573f-4876-80f5-5f4eedec50a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.304120 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea704d-573f-4876-80f5-5f4eedec50a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.306018 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea704d-573f-4876-80f5-5f4eedec50a7 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.327095 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1410/2836] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:10:43 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:43.331327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632301eb-e0f2-479e-a415-feea66e82891 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.341374 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632301eb-e0f2-479e-a415-feea66e82891 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.345912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82093-2be1-4ba5-8e0f-7802397cf849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.346495 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82093-2be1-4ba5-8e0f-7802397cf849 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.346796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82093-2be1-4ba5-8e0f-7802397cf849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.347079 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82093-2be1-4ba5-8e0f-7802397cf849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.347733 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb82093-2be1-4ba5-8e0f-7802397cf849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.349298 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb82093-2be1-4ba5-8e0f-7802397cf849 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.359841 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1427/2837] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:43.363811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea704d-573f-4876-80f5-5f4eedec50a7 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.374609 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea704d-573f-4876-80f5-5f4eedec50a7 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.379170 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd54cd6-7cd8-4d60-8430-f5ce5d2a538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.379757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd54cd6-7cd8-4d60-8430-f5ce5d2a538a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.380030 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd54cd6-7cd8-4d60-8430-f5ce5d2a538a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.380298 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd54cd6-7cd8-4d60-8430-f5ce5d2a538a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.380934 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd54cd6-7cd8-4d60-8430-f5ce5d2a538a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.382506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd54cd6-7cd8-4d60-8430-f5ce5d2a538a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.393077 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1411/2838] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:10:43.397428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82093-2be1-4ba5-8e0f-7802397cf849 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.407578 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82093-2be1-4ba5-8e0f-7802397cf849 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.412210 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1e028-4cb4-449d-a122-d1fbe86d6486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.412823 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1e028-4cb4-449d-a122-d1fbe86d6486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.413099 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1e028-4cb4-449d-a122-d1fbe86d6486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.413373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1e028-4cb4-449d-a122-d1fbe86d6486 admin admin] PATH_INFO: `/v3/projects/170b9318098a4019baf248eaedd5b729/users/c80f639a781c455eabe5cc8a354ba5ac/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.429345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1e028-4cb4-449d-a122-d1fbe86d6486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170b9318098a4019baf248eaedd5b729, user_id=c80f639a781c455eabe5cc8a354ba5ac, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.432016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1e028-4cb4-449d-a122-d1fbe86d6486 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.445013 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1428/2839] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:43 2022] PUT /identity/v3/projects/170b9318098a4019baf248eaedd5b729/users/c80f639a781c455eabe5cc8a354ba5ac/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:43.456266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98094a02-ee22-48a7-84c0-171538911800 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.456549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98094a02-ee22-48a7-84c0-171538911800 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.456822 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98094a02-ee22-48a7-84c0-171538911800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.484426 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-98094a02-ee22-48a7-84c0-171538911800 None None] MFA Rules not processed for user `c80f639a781c455eabe5cc8a354ba5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:43.485624 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-98094a02-ee22-48a7-84c0-171538911800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:43.532255 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:43.551646 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1412/2840] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:43.556187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1e028-4cb4-449d-a122-d1fbe86d6486 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.620017 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1e028-4cb4-449d-a122-d1fbe86d6486 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.624810 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e53690-dec0-4c93-b8d6-5639fb63c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.625345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e53690-dec0-4c93-b8d6-5639fb63c6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.625621 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e53690-dec0-4c93-b8d6-5639fb63c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.625887 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e53690-dec0-4c93-b8d6-5639fb63c6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.626504 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e53690-dec0-4c93-b8d6-5639fb63c6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.628416 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e53690-dec0-4c93-b8d6-5639fb63c6a4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.655041 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1429/2841] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:10:43 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:43.659080 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98094a02-ee22-48a7-84c0-171538911800 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.670762 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98094a02-ee22-48a7-84c0-171538911800 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.728941 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b003c-66bd-45f4-b22d-94ca4f70b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.729539 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b003c-66bd-45f4-b22d-94ca4f70b079 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.729840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b003c-66bd-45f4-b22d-94ca4f70b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.730718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b003c-66bd-45f4-b22d-94ca4f70b079 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.731516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b003c-66bd-45f4-b22d-94ca4f70b079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.733471 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b003c-66bd-45f4-b22d-94ca4f70b079 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.754113 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1413/2842] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:10:43 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:43.758425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e53690-dec0-4c93-b8d6-5639fb63c6a4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.768944 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e53690-dec0-4c93-b8d6-5639fb63c6a4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.773741 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7af502-3058-4caa-8648-7f960b4ce6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.774318 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7af502-3058-4caa-8648-7f960b4ce6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.774596 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7af502-3058-4caa-8648-7f960b4ce6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.774892 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7af502-3058-4caa-8648-7f960b4ce6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.775523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7af502-3058-4caa-8648-7f960b4ce6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.777992 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7af502-3058-4caa-8648-7f960b4ce6d3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.788413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1430/2843] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:43.793285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b003c-66bd-45f4-b22d-94ca4f70b079 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.803781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b003c-66bd-45f4-b22d-94ca4f70b079 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.809173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ec18b-7b7f-4778-83ab-8221a4497905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.809806 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec18b-7b7f-4778-83ab-8221a4497905 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.810082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec18b-7b7f-4778-83ab-8221a4497905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.810351 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ec18b-7b7f-4778-83ab-8221a4497905 admin admin] PATH_INFO: `/v3/projects/730606af158f43859cebd8df3d141883/users/ba32191135754efa81fd401ba4b4731c/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.825015 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ec18b-7b7f-4778-83ab-8221a4497905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=730606af158f43859cebd8df3d141883, user_id=ba32191135754efa81fd401ba4b4731c, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.827681 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ec18b-7b7f-4778-83ab-8221a4497905 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.840567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1414/2844] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:43 2022] PUT /identity/v3/projects/730606af158f43859cebd8df3d141883/users/ba32191135754efa81fd401ba4b4731c/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:43.844516 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7af502-3058-4caa-8648-7f960b4ce6d3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.854427 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7af502-3058-4caa-8648-7f960b4ce6d3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.897362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:43.911976 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9c69-7845-4858-bdd8-3d72f2ba345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.912597 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9c69-7845-4858-bdd8-3d72f2ba345f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.912872 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9c69-7845-4858-bdd8-3d72f2ba345f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.913141 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9c69-7845-4858-bdd8-3d72f2ba345f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.913766 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9c69-7845-4858-bdd8-3d72f2ba345f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.915379 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9c69-7845-4858-bdd8-3d72f2ba345f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.925876 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1431/2845] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:43.930168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ec18b-7b7f-4778-83ab-8221a4497905 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:43.940531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ec18b-7b7f-4778-83ab-8221a4497905 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:43.945072 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:43.945707 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.945978 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.946243 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] PATH_INFO: `/v3/projects/730606af158f43859cebd8df3d141883/users/ba32191135754efa81fd401ba4b4731c/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.948168 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=730606af158f43859cebd8df3d141883, user_id=ba32191135754efa81fd401ba4b4731c, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:43.951349 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:43.961442 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1415/2846] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:43 2022] PUT /identity/v3/projects/730606af158f43859cebd8df3d141883/users/ba32191135754efa81fd401ba4b4731c/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:43.972433 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a192d-5f1c-4fba-b7e1-6b6bb49f178f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:43.972940 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a192d-5f1c-4fba-b7e1-6b6bb49f178f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:43.973039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a192d-5f1c-4fba-b7e1-6b6bb49f178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:43.999974 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b15a192d-5f1c-4fba-b7e1-6b6bb49f178f None None] MFA Rules not processed for user `ba32191135754efa81fd401ba4b4731c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:44.001163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b15a192d-5f1c-4fba-b7e1-6b6bb49f178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:44.067227 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1432/2847] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:44.079021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:44.080809 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:44.139549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c00e-2cda-4dbc-91c6-b1b02db904ca admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:44.143235 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0a527-8057-46c1-be23-9eeaa112b456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:44.143835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0a527-8057-46c1-be23-9eeaa112b456 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:44.144111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0a527-8057-46c1-be23-9eeaa112b456 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:44.144382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0a527-8057-46c1-be23-9eeaa112b456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:44.154251 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0a527-8057-46c1-be23-9eeaa112b456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:44.155888 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0a527-8057-46c1-be23-9eeaa112b456 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:44.165293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1416/2848] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:44.240941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a192d-5f1c-4fba-b7e1-6b6bb49f178f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:44.251160 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a192d-5f1c-4fba-b7e1-6b6bb49f178f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:44.254697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7716a-098e-41a2-831e-8eeed4387bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:44.255310 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7716a-098e-41a2-831e-8eeed4387bfd service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:44.255582 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7716a-098e-41a2-831e-8eeed4387bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:44.255850 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7716a-098e-41a2-831e-8eeed4387bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:44.318533 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7716a-098e-41a2-831e-8eeed4387bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:44.320087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7716a-098e-41a2-831e-8eeed4387bfd service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:44.329395 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1433/2849] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:50.313749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0a527-8057-46c1-be23-9eeaa112b456 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:50.360261 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:50.378164 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0a527-8057-46c1-be23-9eeaa112b456 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:50.382602 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:50.383246 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:50.383523 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:50.383794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] PATH_INFO: `/v3/users/c80f639a781c455eabe5cc8a354ba5ac` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:50.384922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80f639a781c455eabe5cc8a354ba5ac)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:50.387558 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:50.432576 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80f639a781c455eabe5cc8a354ba5ac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:50.440458 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80f639a781c455eabe5cc8a354ba5ac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:50.441073 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80f639a781c455eabe5cc8a354ba5ac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:50.441669 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80f639a781c455eabe5cc8a354ba5ac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:50.448559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80f639a781c455eabe5cc8a354ba5ac'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:50.466082 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1417/2850] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:10:50 2022] DELETE /identity/v3/users/c80f639a781c455eabe5cc8a354ba5ac => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:50.470769 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086333-3fff-4600-b3d6-4e369d64af73 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:50.471241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086333-3fff-4600-b3d6-4e369d64af73 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:50.471339 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086333-3fff-4600-b3d6-4e369d64af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:50.491736 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-80086333-3fff-4600-b3d6-4e369d64af73 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:50.493105 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-80086333-3fff-4600-b3d6-4e369d64af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:50.551461 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1434/2851] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:50.561798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:50.563281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:50.623063 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e12f48-6312-49a1-a521-216dd79d8782 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:50.626642 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97120d-1b4b-440b-9a86-b5f854275359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:50.627312 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97120d-1b4b-440b-9a86-b5f854275359 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:50.627585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97120d-1b4b-440b-9a86-b5f854275359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:50.627854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97120d-1b4b-440b-9a86-b5f854275359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:50.637441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97120d-1b4b-440b-9a86-b5f854275359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:50.638840 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97120d-1b4b-440b-9a86-b5f854275359 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:50.648568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1418/2852] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:50.919930 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80086333-3fff-4600-b3d6-4e369d64af73 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:50.921497 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-80086333-3fff-4600-b3d6-4e369d64af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:50.935135 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80086333-3fff-4600-b3d6-4e369d64af73 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:50.939704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:50.940378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:50.940677 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:50.940941 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] PATH_INFO: `/v3/projects/170b9318098a4019baf248eaedd5b729` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:50.942546 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170b9318098a4019baf248eaedd5b729)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:50.944653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:50.946419 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:50.992323 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170b9318098a4019baf248eaedd5b729', 'request_id': 'req-ad0a2e9f-84a8-437d-8170-e5a421b6a241'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:50.998598 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170b9318098a4019baf248eaedd5b729', 'request_id': 'req-ad0a2e9f-84a8-437d-8170-e5a421b6a241'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.006153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170b9318098a4019baf248eaedd5b729', 'request_id': 'req-ad0a2e9f-84a8-437d-8170-e5a421b6a241'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.017305 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] The token cache is being invalidate because project 170b9318098a4019baf248eaedd5b729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:10:51.017591 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.018218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.019723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1435/2853] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:10:50 2022] DELETE /identity/v3/projects/170b9318098a4019baf248eaedd5b729 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:51.024167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97120d-1b4b-440b-9a86-b5f854275359 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:51.034561 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97120d-1b4b-440b-9a86-b5f854275359 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:51.092316 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:51.092931 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.093204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.093476 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] PATH_INFO: `/v3/users/ba32191135754efa81fd401ba4b4731c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.094574 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba32191135754efa81fd401ba4b4731c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:51.096515 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:51.101718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:51.144854 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba32191135754efa81fd401ba4b4731c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.153081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba32191135754efa81fd401ba4b4731c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.153856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba32191135754efa81fd401ba4b4731c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.154467 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba32191135754efa81fd401ba4b4731c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.161519 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-29ec58c2-46f4-4a9a-9c75-b318d6f8a8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba32191135754efa81fd401ba4b4731c'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.179845 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1419/2854] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:10:51 2022] DELETE /identity/v3/users/ba32191135754efa81fd401ba4b4731c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:51.457587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:51.459145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:51.473642 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a2e9f-84a8-437d-8170-e5a421b6a241 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:51.531370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:51.531994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.532272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.532543 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] PATH_INFO: `/v3/projects/730606af158f43859cebd8df3d141883` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.533750 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] RBAC: Authorizing `identity:delete_project(project_id=730606af158f43859cebd8df3d141883)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:51.535678 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:51.581828 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '730606af158f43859cebd8df3d141883', 'request_id': 'req-0721257b-e3aa-486e-9fcf-76ebf345183e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.587112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '730606af158f43859cebd8df3d141883', 'request_id': 'req-0721257b-e3aa-486e-9fcf-76ebf345183e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.595205 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '730606af158f43859cebd8df3d141883', 'request_id': 'req-0721257b-e3aa-486e-9fcf-76ebf345183e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.606590 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] The token cache is being invalidate because project 730606af158f43859cebd8df3d141883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:10:51.606912 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.607541 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0721257b-e3aa-486e-9fcf-76ebf345183e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:51.609009 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1436/2855] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:10:51 2022] DELETE /identity/v3/projects/730606af158f43859cebd8df3d141883 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:51.613891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6917bd1-47bd-42ca-bd4c-d4c3ce9cb9c8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.614404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6917bd1-47bd-42ca-bd4c-d4c3ce9cb9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.614506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6917bd1-47bd-42ca-bd4c-d4c3ce9cb9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.633705 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d6917bd1-47bd-42ca-bd4c-d4c3ce9cb9c8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:51.634936 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d6917bd1-47bd-42ca-bd4c-d4c3ce9cb9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:51.694567 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1420/2856] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:51.703163 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262988-44e9-4157-8695-edf3fc2a4baa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.703387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262988-44e9-4157-8695-edf3fc2a4baa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.703661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262988-44e9-4157-8695-edf3fc2a4baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.723648 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4f262988-44e9-4157-8695-edf3fc2a4baa None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:51.724862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4f262988-44e9-4157-8695-edf3fc2a4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:51.732735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1437/2857] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:10:51.736862 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6917bd1-47bd-42ca-bd4c-d4c3ce9cb9c8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:51.746507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6917bd1-47bd-42ca-bd4c-d4c3ce9cb9c8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:51.751061 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:51.751633 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.751915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.752188 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.752832 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:10:51.753134 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:51.754724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:51.767116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1421/2858] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:10:51.771629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262988-44e9-4157-8695-edf3fc2a4baa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:51.781479 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262988-44e9-4157-8695-edf3fc2a4baa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:51.786321 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd75175-698e-4dcb-9455-5690519650a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:51.786958 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75175-698e-4dcb-9455-5690519650a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.787236 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75175-698e-4dcb-9455-5690519650a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.787503 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75175-698e-4dcb-9455-5690519650a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.788139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd75175-698e-4dcb-9455-5690519650a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:51.790056 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd75175-698e-4dcb-9455-5690519650a9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:51.801443 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:51.828661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1438/2859] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:10:51 2022] POST /identity/v3/projects => generated 407 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:51.832815 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:51.842830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef56dd-bf1b-4291-be2c-7c4ef66cf75c admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:51.911534 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35f768-7683-4476-bffc-af3a5fc20889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:51.912166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f768-7683-4476-bffc-af3a5fc20889 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.912441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f768-7683-4476-bffc-af3a5fc20889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.912713 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f768-7683-4476-bffc-af3a5fc20889 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.913366 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35f768-7683-4476-bffc-af3a5fc20889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:51.915301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35f768-7683-4476-bffc-af3a5fc20889 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:51.937212 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1422/2860] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:10:51 2022] POST /identity/v3/users => generated 304 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:51.941046 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd75175-698e-4dcb-9455-5690519650a9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:51.951923 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd75175-698e-4dcb-9455-5690519650a9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:51.956601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0831-1a52-4e5e-ab35-6e37956f2bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:51.957134 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0831-1a52-4e5e-ab35-6e37956f2bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.957406 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0831-1a52-4e5e-ab35-6e37956f2bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.957673 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0831-1a52-4e5e-ab35-6e37956f2bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.958303 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0831-1a52-4e5e-ab35-6e37956f2bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:51.959935 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0831-1a52-4e5e-ab35-6e37956f2bcf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:51.969653 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1439/2861] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:51.973661 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35f768-7683-4476-bffc-af3a5fc20889 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:51.979350 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:51.986021 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35f768-7683-4476-bffc-af3a5fc20889 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:51.991959 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e9cc6-26cd-4b09-abc8-afc76eca1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:51.992552 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e9cc6-26cd-4b09-abc8-afc76eca1589 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:51.992856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e9cc6-26cd-4b09-abc8-afc76eca1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:51.993128 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e9cc6-26cd-4b09-abc8-afc76eca1589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:51.993768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e9cc6-26cd-4b09-abc8-afc76eca1589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:51.996118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e9cc6-26cd-4b09-abc8-afc76eca1589 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.008105 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1423/2862] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:52.012880 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0831-1a52-4e5e-ab35-6e37956f2bcf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.025901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0831-1a52-4e5e-ab35-6e37956f2bcf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.030490 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf93072-03e8-4e3f-b356-ea7dd0909da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.031147 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf93072-03e8-4e3f-b356-ea7dd0909da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.031425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf93072-03e8-4e3f-b356-ea7dd0909da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.031697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf93072-03e8-4e3f-b356-ea7dd0909da5 admin admin] PATH_INFO: `/v3/projects/2c05243f8b0c41b8a0b2a7287b0a61b1/users/16a7f27717f04713835c45ebdaa0e2f3/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.046149 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf93072-03e8-4e3f-b356-ea7dd0909da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c05243f8b0c41b8a0b2a7287b0a61b1, user_id=16a7f27717f04713835c45ebdaa0e2f3, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:52.048815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf93072-03e8-4e3f-b356-ea7dd0909da5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.062539 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1440/2863] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:52 2022] PUT /identity/v3/projects/2c05243f8b0c41b8a0b2a7287b0a61b1/users/16a7f27717f04713835c45ebdaa0e2f3/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:52.074449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe5191-b331-47a6-b3be-576b381789dd None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.074736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe5191-b331-47a6-b3be-576b381789dd None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.075038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe5191-b331-47a6-b3be-576b381789dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.102356 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-34fe5191-b331-47a6-b3be-576b381789dd None None] MFA Rules not processed for user `16a7f27717f04713835c45ebdaa0e2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:52.103604 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-34fe5191-b331-47a6-b3be-576b381789dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:52.167324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1424/2864] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:52 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:52.172493 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf93072-03e8-4e3f-b356-ea7dd0909da5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.235972 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf93072-03e8-4e3f-b356-ea7dd0909da5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.240512 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1770a-cc62-4ea3-abf3-427a22d5c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.241096 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1770a-cc62-4ea3-abf3-427a22d5c198 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.241368 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1770a-cc62-4ea3-abf3-427a22d5c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.241636 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1770a-cc62-4ea3-abf3-427a22d5c198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.242248 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1770a-cc62-4ea3-abf3-427a22d5c198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:52.244165 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1770a-cc62-4ea3-abf3-427a22d5c198 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.270638 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1441/2865] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:10:52 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:52.275059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe5191-b331-47a6-b3be-576b381789dd None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.286076 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe5191-b331-47a6-b3be-576b381789dd None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.344167 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28063587-5b86-4294-9836-d3827234be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.344768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28063587-5b86-4294-9836-d3827234be77 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.345046 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28063587-5b86-4294-9836-d3827234be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.345317 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28063587-5b86-4294-9836-d3827234be77 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.345940 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28063587-5b86-4294-9836-d3827234be77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:52.347878 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28063587-5b86-4294-9836-d3827234be77 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.368390 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1425/2866] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:10:52 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:52.372634 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1770a-cc62-4ea3-abf3-427a22d5c198 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.382723 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1770a-cc62-4ea3-abf3-427a22d5c198 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.388071 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0761d-893c-4fcb-b4c1-b187cef8e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.388668 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0761d-893c-4fcb-b4c1-b187cef8e1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.388946 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0761d-893c-4fcb-b4c1-b187cef8e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.389218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0761d-893c-4fcb-b4c1-b187cef8e1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.389910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0761d-893c-4fcb-b4c1-b187cef8e1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:52.391554 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0761d-893c-4fcb-b4c1-b187cef8e1bc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.403670 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1442/2867] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:52.407677 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28063587-5b86-4294-9836-d3827234be77 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.417531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28063587-5b86-4294-9836-d3827234be77 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.422101 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f63b-1878-4013-adcb-ada48cfb8ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.422738 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f63b-1878-4013-adcb-ada48cfb8ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.423194 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f63b-1878-4013-adcb-ada48cfb8ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.423331 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f63b-1878-4013-adcb-ada48cfb8ef9 admin admin] PATH_INFO: `/v3/projects/cacd2db23af749fca16f7b430af61791/users/1dbc33a0966c46cdaa6a761c88c260fe/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.440055 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429f63b-1878-4013-adcb-ada48cfb8ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacd2db23af749fca16f7b430af61791, user_id=1dbc33a0966c46cdaa6a761c88c260fe, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:52.442706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429f63b-1878-4013-adcb-ada48cfb8ef9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.455944 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1426/2868] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:52 2022] PUT /identity/v3/projects/cacd2db23af749fca16f7b430af61791/users/1dbc33a0966c46cdaa6a761c88c260fe/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:52.459962 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0761d-893c-4fcb-b4c1-b187cef8e1bc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.470331 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0761d-893c-4fcb-b4c1-b187cef8e1bc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.529681 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4cbf-a9d2-457f-8a87-2ea9751060cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.530408 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4cbf-a9d2-457f-8a87-2ea9751060cb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.530561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4cbf-a9d2-457f-8a87-2ea9751060cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.530863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4cbf-a9d2-457f-8a87-2ea9751060cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.531523 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a4cbf-a9d2-457f-8a87-2ea9751060cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:52.533103 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a4cbf-a9d2-457f-8a87-2ea9751060cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.542742 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1443/2869] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:10:52.547293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f63b-1878-4013-adcb-ada48cfb8ef9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.557582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f63b-1878-4013-adcb-ada48cfb8ef9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.562714 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.563377 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.563652 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.563920 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] PATH_INFO: `/v3/projects/cacd2db23af749fca16f7b430af61791/users/1dbc33a0966c46cdaa6a761c88c260fe/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.565811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacd2db23af749fca16f7b430af61791, user_id=1dbc33a0966c46cdaa6a761c88c260fe, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:52.568488 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.579272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1427/2870] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:52 2022] PUT /identity/v3/projects/cacd2db23af749fca16f7b430af61791/users/1dbc33a0966c46cdaa6a761c88c260fe/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:10:52.589576 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1f14-d7c5-4f5c-8b4c-9d29f9ee1161 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.589864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1f14-d7c5-4f5c-8b4c-9d29f9ee1161 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.590137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1f14-d7c5-4f5c-8b4c-9d29f9ee1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.617610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eefa1f14-d7c5-4f5c-8b4c-9d29f9ee1161 None None] MFA Rules not processed for user `1dbc33a0966c46cdaa6a761c88c260fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:52.618843 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eefa1f14-d7c5-4f5c-8b4c-9d29f9ee1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:52.624532 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:52.690928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1444/2871] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:52.702232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.703999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:52.738606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:52.763002 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879ff5e-917f-42c8-9fd7-47b6d07d995b admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.766696 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97a898-74eb-4546-93d4-f7a15d7654e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.767321 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97a898-74eb-4546-93d4-f7a15d7654e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.767601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97a898-74eb-4546-93d4-f7a15d7654e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.767872 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97a898-74eb-4546-93d4-f7a15d7654e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:52.777244 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97a898-74eb-4546-93d4-f7a15d7654e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:52.778675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97a898-74eb-4546-93d4-f7a15d7654e4 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:52.788081 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1428/2872] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:52 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:52.942440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa1f14-d7c5-4f5c-8b4c-9d29f9ee1161 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:52.952040 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa1f14-d7c5-4f5c-8b4c-9d29f9ee1161 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:52.955627 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afafe6-f286-4c32-b3a9-d41a094b3a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:52.956212 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afafe6-f286-4c32-b3a9-d41a094b3a25 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:52.956487 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afafe6-f286-4c32-b3a9-d41a094b3a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:52.956757 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afafe6-f286-4c32-b3a9-d41a094b3a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:53.015060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afafe6-f286-4c32-b3a9-d41a094b3a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:53.016486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afafe6-f286-4c32-b3a9-d41a094b3a25 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:53.025396 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1445/2873] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:10:58.278962 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97a898-74eb-4546-93d4-f7a15d7654e4 service cinder] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:58.344975 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97a898-74eb-4546-93d4-f7a15d7654e4 service cinder] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:58.349544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:58.350160 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:58.350433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:58.350700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] PATH_INFO: `/v3/users/16a7f27717f04713835c45ebdaa0e2f3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:58.352004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a7f27717f04713835c45ebdaa0e2f3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:58.353758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:58.399271 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a7f27717f04713835c45ebdaa0e2f3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.407136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a7f27717f04713835c45ebdaa0e2f3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.407753 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a7f27717f04713835c45ebdaa0e2f3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.408354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a7f27717f04713835c45ebdaa0e2f3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.415407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a7f27717f04713835c45ebdaa0e2f3'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.432490 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1429/2874] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:10:58 2022] DELETE /identity/v3/users/16a7f27717f04713835c45ebdaa0e2f3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:10:58.437295 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aba78-b499-4e83-94ba-b7b6461e5938 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:58.437791 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aba78-b499-4e83-94ba-b7b6461e5938 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:58.437897 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aba78-b499-4e83-94ba-b7b6461e5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:58.457064 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8e4aba78-b499-4e83-94ba-b7b6461e5938 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:58.458257 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8e4aba78-b499-4e83-94ba-b7b6461e5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:58.515273 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1446/2875] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:58.525227 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:58.526620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:58.582740 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4a26-14ca-4470-9350-9d58cdff0ebe admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:58.586296 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d201cc0-d4b8-4daa-bc21-160bbf1d619b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:58.586910 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d201cc0-d4b8-4daa-bc21-160bbf1d619b service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:58.587211 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d201cc0-d4b8-4daa-bc21-160bbf1d619b service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:58.587477 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d201cc0-d4b8-4daa-bc21-160bbf1d619b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:58.596531 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d201cc0-d4b8-4daa-bc21-160bbf1d619b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:58.597949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d201cc0-d4b8-4daa-bc21-160bbf1d619b service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:58.601780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:58.609281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1430/2876] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:10:58.880418 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aba78-b499-4e83-94ba-b7b6461e5938 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:58.881921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8e4aba78-b499-4e83-94ba-b7b6461e5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:58.896302 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aba78-b499-4e83-94ba-b7b6461e5938 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:58.902806 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:58.903446 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:58.903833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:58.903986 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] PATH_INFO: `/v3/projects/2c05243f8b0c41b8a0b2a7287b0a61b1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:58.905327 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c05243f8b0c41b8a0b2a7287b0a61b1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:58.907451 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:58.947087 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:58.957616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c05243f8b0c41b8a0b2a7287b0a61b1', 'request_id': 'req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.963112 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c05243f8b0c41b8a0b2a7287b0a61b1', 'request_id': 'req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.970700 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c05243f8b0c41b8a0b2a7287b0a61b1', 'request_id': 'req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.981814 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] The token cache is being invalidate because project 2c05243f8b0c41b8a0b2a7287b0a61b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:10:58.982113 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.982711 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:58.984186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1447/2877] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:10:58 2022] DELETE /identity/v3/projects/2c05243f8b0c41b8a0b2a7287b0a61b1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:58.988218 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d201cc0-d4b8-4daa-bc21-160bbf1d619b service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:58.998213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d201cc0-d4b8-4daa-bc21-160bbf1d619b service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:59.054425 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:59.055087 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.055369 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.055641 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] PATH_INFO: `/v3/users/1dbc33a0966c46cdaa6a761c88c260fe` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.056757 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dbc33a0966c46cdaa6a761c88c260fe)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:59.058718 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:59.104449 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dbc33a0966c46cdaa6a761c88c260fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.111901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dbc33a0966c46cdaa6a761c88c260fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.112665 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dbc33a0966c46cdaa6a761c88c260fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.113268 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dbc33a0966c46cdaa6a761c88c260fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.120981 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-065910af-19b3-49bd-8f8b-45028ff8c942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dbc33a0966c46cdaa6a761c88c260fe'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.139724 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1431/2878] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:10:58 2022] DELETE /identity/v3/users/1dbc33a0966c46cdaa6a761c88c260fe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:59.415137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:59.416567 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:59.431998 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d958e45-3e79-4e0c-9b8f-e7ed07a63753 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:59.489812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:59.490486 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.490662 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.491043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] PATH_INFO: `/v3/projects/cacd2db23af749fca16f7b430af61791` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.492142 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacd2db23af749fca16f7b430af61791)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:59.494146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:59.538864 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacd2db23af749fca16f7b430af61791', 'request_id': 'req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.544187 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacd2db23af749fca16f7b430af61791', 'request_id': 'req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.551299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacd2db23af749fca16f7b430af61791', 'request_id': 'req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.562525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] The token cache is being invalidate because project cacd2db23af749fca16f7b430af61791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:10:59.562838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.563452 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a88c0265-50f7-4b8e-9bc6-7c05d93c7b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:10:59.564884 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1448/2879] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:10:59 2022] DELETE /identity/v3/projects/cacd2db23af749fca16f7b430af61791 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:10:59.569700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3f92-4824-48af-8e62-396265c91ef8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.570166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3f92-4824-48af-8e62-396265c91ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.570265 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3f92-4824-48af-8e62-396265c91ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.591560 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-cb0e3f92-4824-48af-8e62-396265c91ef8 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:59.592780 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-cb0e3f92-4824-48af-8e62-396265c91ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:59.651171 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1432/2880] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:59.660157 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b60e-c8cd-4db0-8dcc-899906480858 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.660436 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b60e-c8cd-4db0-8dcc-899906480858 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.660707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b60e-c8cd-4db0-8dcc-899906480858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.680778 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1953b60e-c8cd-4db0-8dcc-899906480858 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:10:59.681979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1953b60e-c8cd-4db0-8dcc-899906480858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:10:59.690296 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1449/2881] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:10:59.694559 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3f92-4824-48af-8e62-396265c91ef8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:59.704269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3f92-4824-48af-8e62-396265c91ef8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:59.708979 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:59.709617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.709891 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.710163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.710880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:10:59.711187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:59.712834 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:59.724592 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1433/2882] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:10:59.729000 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b60e-c8cd-4db0-8dcc-899906480858 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:59.738901 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b60e-c8cd-4db0-8dcc-899906480858 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:59.743589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a0283-b16e-4122-9463-b529c1b0229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:59.744118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0283-b16e-4122-9463-b529c1b0229c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.744393 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0283-b16e-4122-9463-b529c1b0229c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.744661 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0283-b16e-4122-9463-b529c1b0229c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.745288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a0283-b16e-4122-9463-b529c1b0229c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:59.747356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a0283-b16e-4122-9463-b529c1b0229c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:59.774710 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1450/2883] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:10:59 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:59.779656 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:59.786111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:59.790037 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399eacc-5b9d-495f-a1d7-508d4d17ffaa admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:59.847616 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72725f-1f60-488e-a8c3-e8830a5509e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:59.848219 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72725f-1f60-488e-a8c3-e8830a5509e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.848497 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72725f-1f60-488e-a8c3-e8830a5509e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.848768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72725f-1f60-488e-a8c3-e8830a5509e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.849507 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72725f-1f60-488e-a8c3-e8830a5509e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:59.851468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72725f-1f60-488e-a8c3-e8830a5509e9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:59.871964 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1434/2884] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:10:59 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:10:59.876027 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a0283-b16e-4122-9463-b529c1b0229c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:59.886604 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a0283-b16e-4122-9463-b529c1b0229c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:59.891193 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd408-38b4-4898-bedb-1968e1582ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:59.891782 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd408-38b4-4898-bedb-1968e1582ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.892060 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd408-38b4-4898-bedb-1968e1582ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.892338 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd408-38b4-4898-bedb-1968e1582ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.893001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dd408-38b4-4898-bedb-1968e1582ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:59.894587 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dd408-38b4-4898-bedb-1968e1582ce1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:59.905249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1451/2885] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:59.909013 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72725f-1f60-488e-a8c3-e8830a5509e9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:59.919281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72725f-1f60-488e-a8c3-e8830a5509e9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:59.923830 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d4281-4427-4e8f-8a2c-cc8687619c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:59.924407 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d4281-4427-4e8f-8a2c-cc8687619c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.924675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d4281-4427-4e8f-8a2c-cc8687619c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.924938 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d4281-4427-4e8f-8a2c-cc8687619c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.925566 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d4281-4427-4e8f-8a2c-cc8687619c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:59.927173 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d4281-4427-4e8f-8a2c-cc8687619c19 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:59.937571 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1435/2886] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:10:59.941707 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd408-38b4-4898-bedb-1968e1582ce1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:10:59.952313 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd408-38b4-4898-bedb-1968e1582ce1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:10:59.956924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a5134-a5b2-4806-9578-e2c6f8d701c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:10:59.957568 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5134-a5b2-4806-9578-e2c6f8d701c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:10:59.957844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5134-a5b2-4806-9578-e2c6f8d701c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:10:59.958118 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5134-a5b2-4806-9578-e2c6f8d701c1 admin admin] PATH_INFO: `/v3/projects/8ae32e12614d4bf98c8af31893850cb3/users/74b923812c6c4c66a277cf9c77cf9ba1/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:10:59.970573 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:59.973891 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a5134-a5b2-4806-9578-e2c6f8d701c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae32e12614d4bf98c8af31893850cb3, user_id=74b923812c6c4c66a277cf9c77cf9ba1, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:10:59.977358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a5134-a5b2-4806-9578-e2c6f8d701c1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:10:59.990727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1452/2887] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:10:59 2022] PUT /identity/v3/projects/8ae32e12614d4bf98c8af31893850cb3/users/74b923812c6c4c66a277cf9c77cf9ba1/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:00.054581 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9a7a-e490-4493-84e3-43bd8bf0d3c4 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.054880 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9a7a-e490-4493-84e3-43bd8bf0d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.055136 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9a7a-e490-4493-84e3-43bd8bf0d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.083601 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-5e7a9a7a-e490-4493-84e3-43bd8bf0d3c4 None None] MFA Rules not processed for user `74b923812c6c4c66a277cf9c77cf9ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:00.084795 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-5e7a9a7a-e490-4493-84e3-43bd8bf0d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:00.147668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1436/2888] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:00.152241 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a5134-a5b2-4806-9578-e2c6f8d701c1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:00.212928 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a5134-a5b2-4806-9578-e2c6f8d701c1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:00.217644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6063f-6606-4875-8965-5552705b0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:00.218244 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6063f-6606-4875-8965-5552705b0005 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.218502 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6063f-6606-4875-8965-5552705b0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.218796 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6063f-6606-4875-8965-5552705b0005 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.219432 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6063f-6606-4875-8965-5552705b0005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:00.221299 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6063f-6606-4875-8965-5552705b0005 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:00.247358 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1453/2889] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:11:00 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:11:00.251354 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a9a7a-e490-4493-84e3-43bd8bf0d3c4 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:00.261883 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a9a7a-e490-4493-84e3-43bd8bf0d3c4 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:00.317544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46906-514f-4880-ab40-9dcff3777505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:00.318068 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46906-514f-4880-ab40-9dcff3777505 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.318363 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46906-514f-4880-ab40-9dcff3777505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.318606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46906-514f-4880-ab40-9dcff3777505 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.319259 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46906-514f-4880-ab40-9dcff3777505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:00.321163 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46906-514f-4880-ab40-9dcff3777505 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:00.342554 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1437/2890] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:11:00 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:11:00.347104 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6063f-6606-4875-8965-5552705b0005 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:00.358619 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6063f-6606-4875-8965-5552705b0005 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:00.363272 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ca2b1-9a95-44c5-873b-02c28ec8b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:00.363862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ca2b1-9a95-44c5-873b-02c28ec8b761 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.364132 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ca2b1-9a95-44c5-873b-02c28ec8b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.364399 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ca2b1-9a95-44c5-873b-02c28ec8b761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.365126 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ca2b1-9a95-44c5-873b-02c28ec8b761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:00.366963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ca2b1-9a95-44c5-873b-02c28ec8b761 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:00.377913 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1454/2891] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 05:11:00.382198 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46906-514f-4880-ab40-9dcff3777505 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:00.387506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:00.393382 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46906-514f-4880-ab40-9dcff3777505 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:00.398674 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee324b63-ca32-4792-914d-6a02f6f35222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:00.399344 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee324b63-ca32-4792-914d-6a02f6f35222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.399623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee324b63-ca32-4792-914d-6a02f6f35222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.399893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee324b63-ca32-4792-914d-6a02f6f35222 admin admin] PATH_INFO: `/v3/projects/aea315fe1e6149c9ad10f6dda2e24130/users/b308d9fe331141e98819639fc1cf7db0/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.414904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee324b63-ca32-4792-914d-6a02f6f35222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea315fe1e6149c9ad10f6dda2e24130, user_id=b308d9fe331141e98819639fc1cf7db0, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:00.418387 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee324b63-ca32-4792-914d-6a02f6f35222 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:00.430814 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1438/2892] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:11:00 2022] PUT /identity/v3/projects/aea315fe1e6149c9ad10f6dda2e24130/users/b308d9fe331141e98819639fc1cf7db0/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:00.434984 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ca2b1-9a95-44c5-873b-02c28ec8b761 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:00.444844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ca2b1-9a95-44c5-873b-02c28ec8b761 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:00.501594 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d31776-6be4-43ee-b452-9f49414f582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:00.502274 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31776-6be4-43ee-b452-9f49414f582f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.502441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31776-6be4-43ee-b452-9f49414f582f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.502704 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31776-6be4-43ee-b452-9f49414f582f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.503356 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d31776-6be4-43ee-b452-9f49414f582f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:00.504906 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d31776-6be4-43ee-b452-9f49414f582f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:00.514963 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1455/2893] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:11:00.519420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee324b63-ca32-4792-914d-6a02f6f35222 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:00.530726 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee324b63-ca32-4792-914d-6a02f6f35222 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:00.535279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:00.535911 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.536186 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.536453 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] PATH_INFO: `/v3/projects/aea315fe1e6149c9ad10f6dda2e24130/users/b308d9fe331141e98819639fc1cf7db0/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.538360 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea315fe1e6149c9ad10f6dda2e24130, user_id=b308d9fe331141e98819639fc1cf7db0, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:00.541022 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:00.551031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1439/2894] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:11:00 2022] PUT /identity/v3/projects/aea315fe1e6149c9ad10f6dda2e24130/users/b308d9fe331141e98819639fc1cf7db0/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:00.561166 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2638d-f00f-47ef-84b7-3803a222541e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.561449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2638d-f00f-47ef-84b7-3803a222541e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.561738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2638d-f00f-47ef-84b7-3803a222541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.590092 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-87b2638d-f00f-47ef-84b7-3803a222541e None None] MFA Rules not processed for user `b308d9fe331141e98819639fc1cf7db0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:00.591519 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-87b2638d-f00f-47ef-84b7-3803a222541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:00.638498 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:00.661750 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1456/2895] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:11:00.673918 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:00.675640 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:00.733405 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa8113-9f89-4caa-8fc5-0f6c8f15c2ac admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:00.737119 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaf2eb-7207-4350-ad68-55e6d92b3336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:00.737712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaf2eb-7207-4350-ad68-55e6d92b3336 service cinder] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:00.737991 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaf2eb-7207-4350-ad68-55e6d92b3336 service cinder] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:00.738258 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaf2eb-7207-4350-ad68-55e6d92b3336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:00.747637 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaf2eb-7207-4350-ad68-55e6d92b3336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:00.749060 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaf2eb-7207-4350-ad68-55e6d92b3336 service cinder] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:00.758957 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1440/2896] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:01.130161 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2638d-f00f-47ef-84b7-3803a222541e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:01.192054 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2638d-f00f-47ef-84b7-3803a222541e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:01.196511 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:01.197115 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:01.197383 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:01.197646 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] PATH_INFO: `/v3/users/74b923812c6c4c66a277cf9c77cf9ba1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:01.198863 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b923812c6c4c66a277cf9c77cf9ba1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:01.201076 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:01.246697 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b923812c6c4c66a277cf9c77cf9ba1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.254077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b923812c6c4c66a277cf9c77cf9ba1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.254720 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b923812c6c4c66a277cf9c77cf9ba1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.255304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b923812c6c4c66a277cf9c77cf9ba1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.262320 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b923812c6c4c66a277cf9c77cf9ba1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.279266 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1457/2897] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:11:01 2022] DELETE /identity/v3/users/74b923812c6c4c66a277cf9c77cf9ba1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:01.283771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20a52-9d57-4c7c-8bb2-e87c43a0ac64 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:01.284053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20a52-9d57-4c7c-8bb2-e87c43a0ac64 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:01.284323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20a52-9d57-4c7c-8bb2-e87c43a0ac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:01.303484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-69e20a52-9d57-4c7c-8bb2-e87c43a0ac64 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:01.304676 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-69e20a52-9d57-4c7c-8bb2-e87c43a0ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:01.361943 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1441/2898] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:01.372235 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:01.373601 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:01.429669 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68dd4b-9842-4ff9-82a6-c95f0e7bbc59 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:01.434116 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b77b6-c7f4-4503-9ce7-cb8c2fc1ab27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:01.434717 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b77b6-c7f4-4503-9ce7-cb8c2fc1ab27 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:01.435043 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b77b6-c7f4-4503-9ce7-cb8c2fc1ab27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:01.435312 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b77b6-c7f4-4503-9ce7-cb8c2fc1ab27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:01.444425 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b77b6-c7f4-4503-9ce7-cb8c2fc1ab27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:01.445844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b77b6-c7f4-4503-9ce7-cb8c2fc1ab27 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:01.455225 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1458/2899] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 05:11:01.722628 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20a52-9d57-4c7c-8bb2-e87c43a0ac64 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:01.724152 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-69e20a52-9d57-4c7c-8bb2-e87c43a0ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:01.736798 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20a52-9d57-4c7c-8bb2-e87c43a0ac64 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:01.741516 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:01.742145 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:01.742424 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:01.742692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] PATH_INFO: `/v3/projects/8ae32e12614d4bf98c8af31893850cb3` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:01.743871 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae32e12614d4bf98c8af31893850cb3)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:01.745838 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:01.794379 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae32e12614d4bf98c8af31893850cb3', 'request_id': 'req-55d66625-30c9-471c-8507-7088422961e9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.800086 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae32e12614d4bf98c8af31893850cb3', 'request_id': 'req-55d66625-30c9-471c-8507-7088422961e9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.804839 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:01.810232 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae32e12614d4bf98c8af31893850cb3', 'request_id': 'req-55d66625-30c9-471c-8507-7088422961e9'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.822484 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] The token cache is being invalidate because project 8ae32e12614d4bf98c8af31893850cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:11:01.822791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.823441 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.824908 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1442/2900] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:11:01 2022] DELETE /identity/v3/projects/8ae32e12614d4bf98c8af31893850cb3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:01.829067 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b77b6-c7f4-4503-9ce7-cb8c2fc1ab27 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:01.838560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b77b6-c7f4-4503-9ce7-cb8c2fc1ab27 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:01.843776 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:01.895402 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:01.895934 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:01.896468 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:01.896735 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] PATH_INFO: `/v3/users/b308d9fe331141e98819639fc1cf7db0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:01.897831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b308d9fe331141e98819639fc1cf7db0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:01.899760 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:01.946145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b308d9fe331141e98819639fc1cf7db0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.954398 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b308d9fe331141e98819639fc1cf7db0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.955065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b308d9fe331141e98819639fc1cf7db0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.955671 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b308d9fe331141e98819639fc1cf7db0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.962560 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-68bac01b-2001-44eb-92ce-e5adf0e07cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b308d9fe331141e98819639fc1cf7db0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:01.979921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1459/2901] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:11:01 2022] DELETE /identity/v3/users/b308d9fe331141e98819639fc1cf7db0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:02.243768 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:02.245215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:02.258706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66625-30c9-471c-8507-7088422961e9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:02.316719 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:02.317341 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.317620 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.317889 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] PATH_INFO: `/v3/projects/aea315fe1e6149c9ad10f6dda2e24130` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.319023 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea315fe1e6149c9ad10f6dda2e24130)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:02.320916 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:02.371835 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea315fe1e6149c9ad10f6dda2e24130', 'request_id': 'req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:02.377196 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea315fe1e6149c9ad10f6dda2e24130', 'request_id': 'req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:02.384053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea315fe1e6149c9ad10f6dda2e24130', 'request_id': 'req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:02.394993 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] The token cache is being invalidate because project aea315fe1e6149c9ad10f6dda2e24130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:11:02.395272 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:02.395902 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-168d7e38-6a7c-4c6d-ae96-ac3b0577c2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:02.397613 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1443/2902] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:11:02 2022] DELETE /identity/v3/projects/aea315fe1e6149c9ad10f6dda2e24130 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:02.403065 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec428f5-fb3d-497c-8a23-878f4bf31ba1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.403344 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec428f5-fb3d-497c-8a23-878f4bf31ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.403610 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec428f5-fb3d-497c-8a23-878f4bf31ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.423682 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fec428f5-fb3d-497c-8a23-878f4bf31ba1 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:02.424824 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fec428f5-fb3d-497c-8a23-878f4bf31ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:02.482547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1460/2903] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:02.491717 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2d29-6bb6-4c9a-a452-fe9d087b8e3d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.491999 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2d29-6bb6-4c9a-a452-fe9d087b8e3d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.492269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2d29-6bb6-4c9a-a452-fe9d087b8e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.512017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-4a1a2d29-6bb6-4c9a-a452-fe9d087b8e3d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:02.513215 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-4a1a2d29-6bb6-4c9a-a452-fe9d087b8e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:02.520996 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1444/2904] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:02.525556 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec428f5-fb3d-497c-8a23-878f4bf31ba1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:02.535857 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec428f5-fb3d-497c-8a23-878f4bf31ba1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:02.540288 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:02.540869 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.541146 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.541413 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.542050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:11:02.542421 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:02.544526 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:02.555708 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1461/2905] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 05:11:02.559926 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2d29-6bb6-4c9a-a452-fe9d087b8e3d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:02.568960 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2d29-6bb6-4c9a-a452-fe9d087b8e3d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:02.573482 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e184c4b-d5d1-48f3-be58-4b6b1e079b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:02.574094 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e184c4b-d5d1-48f3-be58-4b6b1e079b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.574419 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e184c4b-d5d1-48f3-be58-4b6b1e079b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.574690 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e184c4b-d5d1-48f3-be58-4b6b1e079b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.575358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e184c4b-d5d1-48f3-be58-4b6b1e079b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:02.577237 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e184c4b-d5d1-48f3-be58-4b6b1e079b48 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:02.604700 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1445/2906] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:11:02 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:11:02.609862 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:02.619732 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc75d-6566-4e1b-b1a6-5cb0a7cbdf08 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:02.631034 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:02.678137 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8623dd9-4c3f-4137-b0af-c20c09c90e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:02.678675 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623dd9-4c3f-4137-b0af-c20c09c90e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.678979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623dd9-4c3f-4137-b0af-c20c09c90e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.679252 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623dd9-4c3f-4137-b0af-c20c09c90e73 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.679874 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8623dd9-4c3f-4137-b0af-c20c09c90e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:02.681762 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8623dd9-4c3f-4137-b0af-c20c09c90e73 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:02.702847 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1462/2907] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:11:02 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:11:02.707432 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e184c4b-d5d1-48f3-be58-4b6b1e079b48 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:02.718503 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e184c4b-d5d1-48f3-be58-4b6b1e079b48 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:02.723182 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79273-3781-4989-a2f5-5363b3ebdfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:02.723794 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79273-3781-4989-a2f5-5363b3ebdfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.724038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79273-3781-4989-a2f5-5363b3ebdfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.724308 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79273-3781-4989-a2f5-5363b3ebdfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.724969 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf79273-3781-4989-a2f5-5363b3ebdfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:02.726549 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf79273-3781-4989-a2f5-5363b3ebdfb8 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:02.736368 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1446/2908] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:11:02.740260 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8623dd9-4c3f-4137-b0af-c20c09c90e73 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:02.750389 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8623dd9-4c3f-4137-b0af-c20c09c90e73 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:02.754894 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328591a2-67bc-4365-a9fd-e8df532aded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:02.755469 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328591a2-67bc-4365-a9fd-e8df532aded2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.755750 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328591a2-67bc-4365-a9fd-e8df532aded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.756010 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328591a2-67bc-4365-a9fd-e8df532aded2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.756632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328591a2-67bc-4365-a9fd-e8df532aded2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:02.758195 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328591a2-67bc-4365-a9fd-e8df532aded2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:02.769378 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1463/2909] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:11:02.773720 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79273-3781-4989-a2f5-5363b3ebdfb8 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:02.784169 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79273-3781-4989-a2f5-5363b3ebdfb8 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:02.788742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:02.789376 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.789653 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.789922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] PATH_INFO: `/v3/projects/17ba61404319431db7af36c2bee54f9c/users/6df073adb0e84cfa82fdc0326244ec9b/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.804631 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ba61404319431db7af36c2bee54f9c, user_id=6df073adb0e84cfa82fdc0326244ec9b, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:02.807355 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:02.820140 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1447/2910] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:11:02 2022] PUT /identity/v3/projects/17ba61404319431db7af36c2bee54f9c/users/6df073adb0e84cfa82fdc0326244ec9b/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:02.826392 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241ac7-84c6-4ad1-8c0d-614655ef05f6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.826698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241ac7-84c6-4ad1-8c0d-614655ef05f6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.826999 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241ac7-84c6-4ad1-8c0d-614655ef05f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.847506 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f8241ac7-84c6-4ad1-8c0d-614655ef05f6 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:02.848701 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f8241ac7-84c6-4ad1-8c0d-614655ef05f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:02.906698 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1464/2911] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:02.917555 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:02.919294 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:02.940004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:02.978575 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05fb05-15d1-48ff-8b71-a31bad0e0837 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:02.982861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672588c-e54b-487e-b2b3-e4afdb7aac95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:02.983461 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672588c-e54b-487e-b2b3-e4afdb7aac95 service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:02.983736 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672588c-e54b-487e-b2b3-e4afdb7aac95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:02.984006 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672588c-e54b-487e-b2b3-e4afdb7aac95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:02.992901 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672588c-e54b-487e-b2b3-e4afdb7aac95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:02.994323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672588c-e54b-487e-b2b3-e4afdb7aac95 service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:03.003691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1448/2912] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:03.777440 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e435a7-6868-47eb-8ccc-7545ba9c430b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:03.777915 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e435a7-6868-47eb-8ccc-7545ba9c430b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:03.778152 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e435a7-6868-47eb-8ccc-7545ba9c430b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:03.812376 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c5e435a7-6868-47eb-8ccc-7545ba9c430b None None] MFA Rules not processed for user `6df073adb0e84cfa82fdc0326244ec9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:03.813618 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5e435a7-6868-47eb-8ccc-7545ba9c430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:03.886001 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1465/2913] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:03.891098 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672588c-e54b-487e-b2b3-e4afdb7aac95 service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:03.901802 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672588c-e54b-487e-b2b3-e4afdb7aac95 service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:03.907330 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dc04a-5650-4f20-a93a-5875d4f24557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:03.907923 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dc04a-5650-4f20-a93a-5875d4f24557 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:03.908224 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dc04a-5650-4f20-a93a-5875d4f24557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:03.908487 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dc04a-5650-4f20-a93a-5875d4f24557 admin admin] PATH_INFO: `/v3/projects` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:03.909116 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dc04a-5650-4f20-a93a-5875d4f24557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:03.911269 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dc04a-5650-4f20-a93a-5875d4f24557 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:03.940307 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1449/2914] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:11:03 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:11:03.944415 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e435a7-6868-47eb-8ccc-7545ba9c430b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:03.955657 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e435a7-6868-47eb-8ccc-7545ba9c430b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:03.976311 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:04.012852 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13683f67-a9b4-4c30-ab24-593c4d8eda0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:04.013449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683f67-a9b4-4c30-ab24-593c4d8eda0a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:04.013724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683f67-a9b4-4c30-ab24-593c4d8eda0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:04.013991 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683f67-a9b4-4c30-ab24-593c4d8eda0a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:04.014611 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13683f67-a9b4-4c30-ab24-593c4d8eda0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:04.016537 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13683f67-a9b4-4c30-ab24-593c4d8eda0a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:04.036780 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1466/2915] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:11:03 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 05:11:04.040856 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dc04a-5650-4f20-a93a-5875d4f24557 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:04.051166 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dc04a-5650-4f20-a93a-5875d4f24557 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:04.055961 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734885c0-5ff5-4bc2-8a3c-290cd2946ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:04.056547 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734885c0-5ff5-4bc2-8a3c-290cd2946ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:04.056819 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734885c0-5ff5-4bc2-8a3c-290cd2946ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:04.057085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734885c0-5ff5-4bc2-8a3c-290cd2946ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:04.057712 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734885c0-5ff5-4bc2-8a3c-290cd2946ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:04.059988 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734885c0-5ff5-4bc2-8a3c-290cd2946ad9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:04.070582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1450/2916] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:11:04.075629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13683f67-a9b4-4c30-ab24-593c4d8eda0a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:04.085632 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13683f67-a9b4-4c30-ab24-593c4d8eda0a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:04.090367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7829b-d216-4951-b4c7-5c5a1733d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:04.091028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7829b-d216-4951-b4c7-5c5a1733d208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:04.091304 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7829b-d216-4951-b4c7-5c5a1733d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:04.091575 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7829b-d216-4951-b4c7-5c5a1733d208 admin admin] PATH_INFO: `/v3/projects/26e3e1a273b84ec08be36546432d1905/users/abb5dc5828724f5fa9209d7369fe8dce/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:04.106409 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7829b-d216-4951-b4c7-5c5a1733d208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e3e1a273b84ec08be36546432d1905, user_id=abb5dc5828724f5fa9209d7369fe8dce, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:04.109123 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7829b-d216-4951-b4c7-5c5a1733d208 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:04.123975 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1467/2917] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:11:04 2022] PUT /identity/v3/projects/26e3e1a273b84ec08be36546432d1905/users/abb5dc5828724f5fa9209d7369fe8dce/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:04.127683 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734885c0-5ff5-4bc2-8a3c-290cd2946ad9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:04.138292 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734885c0-5ff5-4bc2-8a3c-290cd2946ad9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:04.193668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76fc7a-48c1-48a4-b376-6d9678d5c1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:04.194279 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76fc7a-48c1-48a4-b376-6d9678d5c1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:04.194556 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76fc7a-48c1-48a4-b376-6d9678d5c1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:04.194861 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76fc7a-48c1-48a4-b376-6d9678d5c1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:04.195506 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76fc7a-48c1-48a4-b376-6d9678d5c1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:04.197104 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76fc7a-48c1-48a4-b376-6d9678d5c1b5 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:04.207024 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1451/2918] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:11:04.211214 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7829b-d216-4951-b4c7-5c5a1733d208 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:04.221500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7829b-d216-4951-b4c7-5c5a1733d208 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:04.226294 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0229-6cd1-4027-9eb5-7eff505b8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:04.227005 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0229-6cd1-4027-9eb5-7eff505b8523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:04.227280 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0229-6cd1-4027-9eb5-7eff505b8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:04.227547 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0229-6cd1-4027-9eb5-7eff505b8523 admin admin] PATH_INFO: `/v3/projects/26e3e1a273b84ec08be36546432d1905/users/abb5dc5828724f5fa9209d7369fe8dce/roles/278a30c0c1124ebe8c0a3e230255420c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:04.229458 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0229-6cd1-4027-9eb5-7eff505b8523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e3e1a273b84ec08be36546432d1905, user_id=abb5dc5828724f5fa9209d7369fe8dce, role_id=278a30c0c1124ebe8c0a3e230255420c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:04.232680 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0229-6cd1-4027-9eb5-7eff505b8523 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:04.242924 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1468/2919] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:11:04 2022] PUT /identity/v3/projects/26e3e1a273b84ec08be36546432d1905/users/abb5dc5828724f5fa9209d7369fe8dce/roles/278a30c0c1124ebe8c0a3e230255420c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:11:04.853468 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432dab0-00d3-47f1-9bcf-939854f61d63 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:04.853742 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432dab0-00d3-47f1-9bcf-939854f61d63 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:04.854019 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432dab0-00d3-47f1-9bcf-939854f61d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:04.882281 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-6432dab0-00d3-47f1-9bcf-939854f61d63 None None] MFA Rules not processed for user `abb5dc5828724f5fa9209d7369fe8dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:04.883514 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6432dab0-00d3-47f1-9bcf-939854f61d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:04.960450 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1452/2920] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:04.970994 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eba7e-c6b8-4f10-b9c0-9c27777a6f21 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:04.971505 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eba7e-c6b8-4f10-b9c0-9c27777a6f21 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:04.971630 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eba7e-c6b8-4f10-b9c0-9c27777a6f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:04.991800 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-652eba7e-c6b8-4f10-b9c0-9c27777a6f21 None None] MFA Rules not processed for user `6df073adb0e84cfa82fdc0326244ec9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:04.993016 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-652eba7e-c6b8-4f10-b9c0-9c27777a6f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:05.049629 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1469/2921] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:05.063600 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432dab0-00d3-47f1-9bcf-939854f61d63 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:05.065158 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-6432dab0-00d3-47f1-9bcf-939854f61d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:05.076108 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:05.137496 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432dab0-00d3-47f1-9bcf-939854f61d63 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:05.142949 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b877cb99245408b8ca37c9e85eb023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:05.143544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:05.143821 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:05.144091 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:05.152039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:05.153607 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:05.162139 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1453/2922] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:05.195715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eba7e-c6b8-4f10-b9c0-9c27777a6f21 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:05.197085 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-652eba7e-c6b8-4f10-b9c0-9c27777a6f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:05.253449 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eba7e-c6b8-4f10-b9c0-9c27777a6f21 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:05.256979 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a3fcdfea364647ad88070a96793065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:05.257566 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:05.257840 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:05.258101 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:05.259799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:05.273050 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:05.274441 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:05.285153 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1470/2923] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:05.804199 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:05.806102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:05.866675 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960384-5131-4c9f-bf06-37cf8d0c3a1e service nova] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:05.870293 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:05.870970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:05.871248 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:05.871522 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:05.873324 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:05.888157 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:05.889639 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:05.903118 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1454/2924] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:15.280230 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:15.793139 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:15.794570 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:15.850616 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d4d00-a6d4-4ec8-abfb-a94f3adb5407 service glance] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:15.854094 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f0dc-4359-4086-a653-6c847185d793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:15.854724 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f0dc-4359-4086-a653-6c847185d793 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:15.855036 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f0dc-4359-4086-a653-6c847185d793 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:15.855308 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969f0dc-4359-4086-a653-6c847185d793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:15.864077 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969f0dc-4359-4086-a653-6c847185d793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:15.865489 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969f0dc-4359-4086-a653-6c847185d793 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:15.875357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1471/2925] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:15.896358 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=56 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:25.870589 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=26 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:33.990404 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:33.992816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:34.068053 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9fa04-56d3-4253-8d83-157a3b0dad3d service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:34.075085 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:34.075723 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:34.076031 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:34.076204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:34.078179 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:34.090612 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:34.092266 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:34.102692 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1455/2926] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:34.521795 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f0dc-4359-4086-a653-6c847185d793 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:34.534038 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969f0dc-4359-4086-a653-6c847185d793 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:34.539097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:34.539689 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:34.539965 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:34.540237 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:34.542028 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:34.554428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:34.556169 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:34.568218 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1472/2927] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:34.593915 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:34.662701 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b45d3b-559d-41a9-b808-3bc910c4dd15 service placement] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:34.667749 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:34.668428 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:34.668706 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:34.668970 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] PATH_INFO: `/v3/users/6df073adb0e84cfa82fdc0326244ec9b` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:34.670204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df073adb0e84cfa82fdc0326244ec9b)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:34.672210 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:34.718904 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df073adb0e84cfa82fdc0326244ec9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:34.726110 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df073adb0e84cfa82fdc0326244ec9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:34.726725 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df073adb0e84cfa82fdc0326244ec9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:34.727367 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df073adb0e84cfa82fdc0326244ec9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:34.734773 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df073adb0e84cfa82fdc0326244ec9b'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:34.752691 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1456/2928] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:11:34 2022] DELETE /identity/v3/users/6df073adb0e84cfa82fdc0326244ec9b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:34.933500 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:34.947836 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe150282-1930-4c76-90c4-59be863fec2a service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:35.009966 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:35.010833 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.011078 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.011345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] PATH_INFO: `/v3/projects/17ba61404319431db7af36c2bee54f9c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.012706 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ba61404319431db7af36c2bee54f9c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:35.015145 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:35.064718 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ba61404319431db7af36c2bee54f9c', 'request_id': 'req-4114ce3e-4486-45c3-bd74-74927360ab9d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.070297 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ba61404319431db7af36c2bee54f9c', 'request_id': 'req-4114ce3e-4486-45c3-bd74-74927360ab9d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.080715 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ba61404319431db7af36c2bee54f9c', 'request_id': 'req-4114ce3e-4486-45c3-bd74-74927360ab9d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.092039 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] The token cache is being invalidate because project 17ba61404319431db7af36c2bee54f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:11:35.092325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.092960 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.094434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1473/2929] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:11:34 2022] DELETE /identity/v3/projects/17ba61404319431db7af36c2bee54f9c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:35.098544 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:35.099995 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:35.113727 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fca5e-d693-4e99-b477-4bdb506bdbe9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:35.118213 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:35.173763 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:35.174299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.174594 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.174893 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] PATH_INFO: `/v3/users/abb5dc5828724f5fa9209d7369fe8dce` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.176079 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb5dc5828724f5fa9209d7369fe8dce)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:35.177983 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:35.224781 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb5dc5828724f5fa9209d7369fe8dce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.233151 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb5dc5828724f5fa9209d7369fe8dce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.233758 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb5dc5828724f5fa9209d7369fe8dce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.234342 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb5dc5828724f5fa9209d7369fe8dce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.241695 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-e497812b-d273-4efd-8375-d0eab3a575fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb5dc5828724f5fa9209d7369fe8dce'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.259585 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1457/2930] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:11:35 2022] DELETE /identity/v3/users/abb5dc5828724f5fa9209d7369fe8dce => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:35.436990 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:35.438528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:35.451362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ce3e-4486-45c3-bd74-74927360ab9d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:35.519286 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:35.519890 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.520164 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.520434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] PATH_INFO: `/v3/projects/26e3e1a273b84ec08be36546432d1905` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.521792 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e3e1a273b84ec08be36546432d1905)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:35.524306 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:35.548136 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:35.574370 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e3e1a273b84ec08be36546432d1905', 'request_id': 'req-3cda4615-2f3a-463a-b387-88704ac685f6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.579973 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e3e1a273b84ec08be36546432d1905', 'request_id': 'req-3cda4615-2f3a-463a-b387-88704ac685f6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.592278 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e3e1a273b84ec08be36546432d1905', 'request_id': 'req-3cda4615-2f3a-463a-b387-88704ac685f6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.603746 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] The token cache is being invalidate because project 26e3e1a273b84ec08be36546432d1905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:11:35.604690 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.605345 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3cda4615-2f3a-463a-b387-88704ac685f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:35.606838 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1474/2931] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:11:35 2022] DELETE /identity/v3/projects/26e3e1a273b84ec08be36546432d1905 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 05:11:35.611771 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e369-f097-403a-b1bc-4fc11792515d None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.612062 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e369-f097-403a-b1bc-4fc11792515d None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.612343 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e369-f097-403a-b1bc-4fc11792515d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.631853 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-1db8e369-f097-403a-b1bc-4fc11792515d None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:35.633067 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-1db8e369-f097-403a-b1bc-4fc11792515d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:35.697172 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1458/2932] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 05:11:35.705812 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3faee-9aca-4875-9088-2b10ac6e6b2a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.706095 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3faee-9aca-4875-9088-2b10ac6e6b2a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.706362 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3faee-9aca-4875-9088-2b10ac6e6b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.726372 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-55e3faee-9aca-4875-9088-2b10ac6e6b2a None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:35.727615 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55e3faee-9aca-4875-9088-2b10ac6e6b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:35.735900 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1475/2933] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:35.740032 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8e369-f097-403a-b1bc-4fc11792515d None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:35.751059 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8e369-f097-403a-b1bc-4fc11792515d None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:35.755791 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:35.756420 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.756698 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.756971 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] PATH_INFO: `/v3/domains` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.757617 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 05:11:35.757922 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:35.759568 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:35.772034 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1459/2934] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 24 05:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 05:11:35.776492 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3faee-9aca-4875-9088-2b10ac6e6b2a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:35.786354 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3faee-9aca-4875-9088-2b10ac6e6b2a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:35.790995 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e7cd-6c88-43a5-8843-d95acb7eec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:35.791641 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e7cd-6c88-43a5-8843-d95acb7eec0a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.791921 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e7cd-6c88-43a5-8843-d95acb7eec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.792186 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e7cd-6c88-43a5-8843-d95acb7eec0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.792817 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e7cd-6c88-43a5-8843-d95acb7eec0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:35.794727 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e7cd-6c88-43a5-8843-d95acb7eec0a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:35.821861 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1476/2935] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 24 05:11:35 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:11:35.827111 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:35.837096 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c699ab-cd3d-4ee5-90e7-9ba5f7cb1346 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:35.849511 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:35.897502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021d01a-c5b9-447c-87d1-65d168afb170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:35.898102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d01a-c5b9-447c-87d1-65d168afb170 admin admin] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.898381 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d01a-c5b9-447c-87d1-65d168afb170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.898654 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d01a-c5b9-447c-87d1-65d168afb170 admin admin] PATH_INFO: `/v3/users` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.899323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021d01a-c5b9-447c-87d1-65d168afb170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:35.901433 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021d01a-c5b9-447c-87d1-65d168afb170 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:35.923242 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1460/2936] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 24 05:11:35 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 05:11:35.927428 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e7cd-6c88-43a5-8843-d95acb7eec0a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:35.938939 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e7cd-6c88-43a5-8843-d95acb7eec0a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:35.943658 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033664ae-0c24-474a-9f60-e4ff74800f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:35.944249 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033664ae-0c24-474a-9f60-e4ff74800f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.944525 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033664ae-0c24-474a-9f60-e4ff74800f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.944793 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033664ae-0c24-474a-9f60-e4ff74800f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.945423 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033664ae-0c24-474a-9f60-e4ff74800f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:35.947035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033664ae-0c24-474a-9f60-e4ff74800f7a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:35.958844 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1477/2937] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:11:35.962897 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021d01a-c5b9-447c-87d1-65d168afb170 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:35.973353 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021d01a-c5b9-447c-87d1-65d168afb170 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:35.978039 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba5360-e0f4-42af-8d2f-2316216d8a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:35.978623 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5360-e0f4-42af-8d2f-2316216d8a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:35.979498 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5360-e0f4-42af-8d2f-2316216d8a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:35.979811 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5360-e0f4-42af-8d2f-2316216d8a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:35.980644 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba5360-e0f4-42af-8d2f-2316216d8a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:35.982241 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba5360-e0f4-42af-8d2f-2316216d8a3a admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:35.992884 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1461/2938] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 24 05:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 05:11:35.999561 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033664ae-0c24-474a-9f60-e4ff74800f7a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:36.009738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033664ae-0c24-474a-9f60-e4ff74800f7a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:36.014422 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:36.015097 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:36.015373 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:36.015644 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] PATH_INFO: `/v3/projects/f5bc4f86e8af4493bcf8ab3a74c16aac/users/4d99b0a4431743b68e9963a08d8249dc/roles/b916ec3f3c9e4a4980a4dc11ee70ee19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:36.030387 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bc4f86e8af4493bcf8ab3a74c16aac, user_id=4d99b0a4431743b68e9963a08d8249dc, role_id=b916ec3f3c9e4a4980a4dc11ee70ee19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:36.033074 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:36.047367 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1478/2939] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 24 05:11:35 2022] PUT /identity/v3/projects/f5bc4f86e8af4493bcf8ab3a74c16aac/users/4d99b0a4431743b68e9963a08d8249dc/roles/b916ec3f3c9e4a4980a4dc11ee70ee19 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:36.059102 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01272bc-a7f4-488f-9f37-d300fc3db8d8 None None] REQUEST_METHOD: `POST` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:36.059370 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01272bc-a7f4-488f-9f37-d300fc3db8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:36.059645 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01272bc-a7f4-488f-9f37-d300fc3db8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:36.087873 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.auth.core [None req-d01272bc-a7f4-488f-9f37-d300fc3db8d8 None None] MFA Rules not processed for user `4d99b0a4431743b68e9963a08d8249dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:36.089649 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-d01272bc-a7f4-488f-9f37-d300fc3db8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:36.154521 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1462/2940] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:36.165802 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:36.168385 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:36.225827 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eb687-814e-42f1-8cb5-7727a6d1c230 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:36.230089 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c72a4-e1ca-4a9c-bb98-e7299a202fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3f250eacf044f1b760f3b75d4ba33a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:36.230684 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c72a4-e1ca-4a9c-bb98-e7299a202fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:36.230987 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c72a4-e1ca-4a9c-bb98-e7299a202fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:36.231251 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c72a4-e1ca-4a9c-bb98-e7299a202fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:36.239685 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c72a4-e1ca-4a9c-bb98-e7299a202fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:36.241131 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c72a4-e1ca-4a9c-bb98-e7299a202fb0 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:36.250182 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1479/2941] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:41.300066 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01272bc-a7f4-488f-9f37-d300fc3db8d8 None None] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:41.362816 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01272bc-a7f4-488f-9f37-d300fc3db8d8 None None] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:41.367299 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:41.368020 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:41.368301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:41.368579 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] PATH_INFO: `/v3/users/4d99b0a4431743b68e9963a08d8249dc` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:41.369784 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d99b0a4431743b68e9963a08d8249dc)` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:41.371731 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:41.398876 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:41.420225 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d99b0a4431743b68e9963a08d8249dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.426606 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d99b0a4431743b68e9963a08d8249dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.427283 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d99b0a4431743b68e9963a08d8249dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.427954 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d99b0a4431743b68e9963a08d8249dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.435622 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.notifications [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d99b0a4431743b68e9963a08d8249dc'} {{(pid=81363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.452668 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1463/2942] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 24 05:11:41 2022] DELETE /identity/v3/users/4d99b0a4431743b68e9963a08d8249dc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:41.457282 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7279b5-5720-4df7-bb7f-362283161040 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:41.457799 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7279b5-5720-4df7-bb7f-362283161040 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:41.457910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7279b5-5720-4df7-bb7f-362283161040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:41.477035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ae7279b5-5720-4df7-bb7f-362283161040 None None] MFA Rules not processed for user `c9d20f523caa4aca808612f9ede7fc85`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 05:11:41.478229 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae7279b5-5720-4df7-bb7f-362283161040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:41.518328 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:41.536756 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1480/2943] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 24 05:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 05:11:41.547226 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:41.548626 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:41.604647 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2da368-0461-4274-b42a-660230b5d3b9 admin admin] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:41.608323 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f50dc809ff034866a1f6343e5b32609b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:41.608913 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:41.609187 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:41.609456 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:41.618204 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:41.620285 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:41.629582 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1464/2944] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:11:41.894424 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7279b5-5720-4df7-bb7f-362283161040 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:11:41.895859 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae7279b5-5720-4df7-bb7f-362283161040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:11:41.914967 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7279b5-5720-4df7-bb7f-362283161040 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:11:41.921091 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9d20f523caa4aca808612f9ede7fc85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b234c6113f54a018ff39cafffcc9b40', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:11:41.921910 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:11:41.922035 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:11:41.922357 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] PATH_INFO: `/v3/projects/f5bc4f86e8af4493bcf8ab3a74c16aac` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:11:41.923738 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bc4f86e8af4493bcf8ab3a74c16aac)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:11:41.925617 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:11:41.972831 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bc4f86e8af4493bcf8ab3a74c16aac', 'request_id': 'req-06f39680-d45a-4ce1-a01d-e7d02a872f98'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.978238 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bc4f86e8af4493bcf8ab3a74c16aac', 'request_id': 'req-06f39680-d45a-4ce1-a01d-e7d02a872f98'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.985350 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bc4f86e8af4493bcf8ab3a74c16aac', 'request_id': 'req-06f39680-d45a-4ce1-a01d-e7d02a872f98'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.996528 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] The token cache is being invalidate because project f5bc4f86e8af4493bcf8ab3a74c16aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 05:11:41.996815 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.997434 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-06f39680-d45a-4ce1-a01d-e7d02a872f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 05:11:41.998922 dv-cinder-859186-1-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1481/2945] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 24 05:11:41 2022] DELETE /identity/v3/projects/f5bc4f86e8af4493bcf8ab3a74c16aac => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 05:11:51.625502 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:DELETE=6,keystone:SELECT=45,keystone:INSERT=1 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:51.993325 dv-cinder-859186-1-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:09.395004 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] Authenticating user token {{(pid=81363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 05:14:09.396371 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:14:09.465092 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32349f8-1d91-464b-b8e7-6703133d6bda service neutron] Validating token access rules against request {{(pid=81363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 05:14:09.523176 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785a853-94b4-430b-a470-e8c3e2174d34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe631741e1344f08a139c497b5645383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37daef16cf3e4435acd2508ceaf4ce1c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 05:14:09.523767 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a853-94b4-430b-a470-e8c3e2174d34 service placement] REQUEST_METHOD: `GET` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 05:14:09.524038 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a853-94b4-430b-a470-e8c3e2174d34 service placement] SCRIPT_NAME: `/identity` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 05:14:09.524301 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a853-94b4-430b-a470-e8c3e2174d34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 05:14:09.525994 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.fernet_utils [None req-9785a853-94b4-430b-a470-e8c3e2174d34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 05:14:09.537447 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785a853-94b4-430b-a470-e8c3e2174d34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 05:14:09.539017 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785a853-94b4-430b-a470-e8c3e2174d34 service placement] RBAC: Authorization granted {{(pid=81363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 05:14:09.548818 dv-cinder-859186-1-smb devstack@keystone.service[81363]: [pid: 81363|app: 0|req: 1465/2946] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 24 05:14:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 05:14:19.544474 dv-cinder-859186-1-smb devstack@keystone.service[81363]: DEBUG dbcounter [-] [81363] Writing DB stats keystone:SELECT=58 {{(pid=81363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}